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ABSTRACT 



The Common Core of Data (CCD) program of the National Center 
for Education Statistics (NCES) consists of five separate surveys. An 
evaluation was conducted of the nonfiscal surveys from the CCD for 1996-97. 

It focused primarily on the agency and school universe surveys, but it also 
included the state nonfiscal survey. The evaluation explored such issues as 
respondent response time intervals, NCES/agent data processing and editing 
time intervals, and overall survey timeliness and data quality. The 
evaluation did not reveal any major problems or deficiencies in the 1996-97 
nonfiscal CCD surveys data collection, processing, and editing cycle. Most of 
the recommendations resulting from the evaluation relate to improving overall 
survey timeliness, and only a few are directed toward the edits themselves. 
Most of the recommendations represent relatively minor changes to the 
procedures and processes of the existing system. Thirty- four principal 
findings and 18 principal recommendations are listed. Appendixes contain the 
agency universe and school universe error and warning message edit 
descriptions. (Contains 26 tables.) (SLD) 
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PURPOSE OF EVALUATION 



This report was prepared for the National Center for Education Statistics (NCES) by the Governments Division of the 
U. S. Census Bureau. The principal author was Tom Hamann of the Governments Division. The report is part of a series 
that constitutes a comprehensive evaluation of the Common Core of Data (CCD) survey! The purpose of the series is 
to assess the quality of survey data as it relates to coverage, classification, processing, editing, reliability, and validity. 
It is intended to address issues of interest and concern to the NCES and the education community as a whole. This report 
contributes to the comprehensive evaluation by analyzing and providing the results of the evaluation of the data 
collection, processing, and editing cycle of the 1996-97 Nonfiscal CCD Surveys. 
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CHAPTER 1. INTRODUCTION 

Section 1.0 Survey Background and Purpose of 
Evaluation 

The Common Core of Data (CCD) program consists of 
five separate surveys. These include the “Public 
Elementary/Secondary Education Agency Universe 
Survey” (hereafter referred to as the agency survey), the 
“Public Elementary/Secondary School Universe 
Survey” (hereafter referred to as the school survey, the 
“State Nonfiscal Survey”, the “National Public 
Education Finance Survey (NPEFS)”, and the “Early 
Estimates Survey.” The CCD contains three primary 
categories of information - identifying information, 
basic statistics, and fiscal data. 

The National Center for Education Statistics’ (NCES) 
goal for the CCD is a “comprehensive and timely 
national statistical database comparable across all 
states/territories on all public elementary and secondary 
schools, education agencies and programs.” The 
purpose of the CCD is to provide basic statistical 
information on all children in this country receiving a 
free education from prekindergarten through grade 
twelve and on the public funds collected (revenues) and 
expended for providing free public elementary and 
secondary education. 

The results of this evaluation will be used for ongoing 
process improvement of the CCD surveys. Findings 
from this survey may be used to improve the survey as 
a whole and to serve as an identification and basis for 
potential improvements in editing and processing of the 
nonfiscal components of the CCD surveys which are 
being expanded for the 1998-99 school year and 
collection cycle. 

This evaluation explored such issues as respondent 
response time intervals, NCES/agent data processing 
and editing time intervals, as well as overall survey 
timeliness and data quality. A primary objective was to 
assess the effectiveness of the data editing procedures 
and activities that were part of the survey cycle. This 
evaluation consisted of a thorough review of the data 
edits, the associated error and warning messages, and 
the total and type of error counts generated by the 
submitted nonfiscal CCD data at various points in the 
1996-97 survey cycle. 

It is crucial to indicate at the outset that various terms 
used throughout this report, such as “errors,” “edit 
failures,” and “in-error records” do not necessarily 
always indicate incorrect data. The “errors” described 
herein represented situations which were flagged 



essentially because the data responses were not within 
expected ranges. The historical basis for the editing 
process has been primarily to alert respondents of 
potential data outliers or anomalies rather than to find 
data errors per se. 

This evaluation covered only the nonfiscal surveys for 
the year 1996-97. It focused primarily on the agency 
and school universe surveys, but it also included the 
state nonfiscal survey. In this evaluation, the term 
“states” refers to all fifty states, the District of 
Columbia, the five outlying areas of American Samoa, 
Guam, the Commonwealth of Northern Mariana 
Islands, Puerto Rico, the U.S. Virgin Islands, and the 
U.S. Department of Defense (DOD) dependents 
overseas schools. Also, all totals and averages in the 
end-of-chapter tables include all the states and 
territories of the United States. 

This evaluation did not reveal major problems or 
deficiencies in the 1996-97 Nonfiscal CCD Surveys 
data collection, processing, and editing cycle. Most of 
the recommendations provided herein relate to 
improving overall survey timeliness. Only a few are 
directed specifically towards the edits themselves. 
Many of the proposed suggestions, with few exceptions, 
represent relatively minor changes to the procedures 
and processes of the existing system. Indeed, some of 
the recommendations amount to mere presentation 
changes to the data reports which are generated and 
distributed to the states for review and response. Table 
1-1 at the end of this chapter provides an overview of 
some of the more relevant findings of this evaluation. 

Section 1.1 Principal Findings 

The following highlight the main findings, by chapter, 
of this report. A more detailed discussion of these 
findings is presented in the subsequent chapters. 

Chapter 2. The Data Collection , Processing , 
and Editing Cycle 

1. The initial mailout for CCD survey year 1996-97 
requesting data submission was about six weeks 
beyond the scheduled date for a majority of the 
states (some states’ mailout were several months 
late). This delay occurred primarily as the direct 
result of unresolved issues with the previous year’s 
data files. 

2. The average state response time for initial data file 
submission of 15 weeks was about double the eight 
weeks allotted in the target schedule. The range of 
response time varied between two and 39 weeks. 
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Only two states submitted all three data files 
(agency, school, and state nonfiscal) by the due 
date, while 14 states took 30 or more weeks to do 
so. 

3. There was a chronic “lateness” (time beyond due 
date), averaging about 14 weeks, associated with 
the states’ initial data submissions. A full one-third 
of the respondents were as many as 16 weeks late 
in submitting their initial data files. 

4. For two subsequent intervals, at the data summary 
and edit stages, in the survey cycle when states 
were asked to review and correct data, the 
respondents’ average combined response time was 
11 weeks (7 more weeks than the allocated 4 
weeks). Thus, the amount of total time during the 
survey cycle attributable to late responses by the 
states averaged about 21 weeks. 

5. The average total respondent response time was 
about 22 weeks, with a range of eight to 42 weeks. 

6. The total survey cycle time, that is the time elapsed 
from initial mailout to final data file completion, 
for each state in the 1996-97 Nonfiscal CCD 
Surveys averaged just under one year at about 50 
weeks. The longest total survey cycle time for any 
one state was 58 weeks while the shortest was 34 
weeks. 

7. During the reviewed survey cycle 17 states, nearly 
one-third of the respondents, provided either 
complete or partial revisions (some as many as 
three times), to their original data submissions. 

8. As was the case for the previous year, these 
respondent response and survey completion 
timings had several consequences - the most 
compelling of which was to delay the subsequent 
year’s initial mailout date and, hence, the entire 
survey cycle. Many of the issues relating to survey 
timeliness that were raised in this evaluation 
apparently would be addressed through a more 
timely initial mailout and completion of the annual 
survey cycle within the prescribed survey time 
frame. 

Chapter 3. Agency and School Universe CCD 
Surveys Processing and Editing 
Stages 

9. A major bottleneck and time delay in the 
processing and editing of nonfiscal CCD data files 
occurred as a result of issues and problems 



identified in the data summary (particularly the 
match report) and identification (ID) assignment 
stages of the survey cycle. Delays often occurred as 
a result of the NCES/agent having to wait for 
respondents to provide necessary data 
clarifications and corrections in order that they 
establish the overall survey universe and proceed 
with the data processing and editing. 

10. In general, the internal report and the 
corresponding phase of the process and editing 
cycle were found to be thorough and useful, 
particularly in preparing the state data files for the 
more stringent edit checks to follow. However, 
many of the data checks and edits associated with 
the identifying and administrative information 
found in the internal report, while important for 
agency and school record completeness and 
accuracy, essentially performed validity checks on 
data which could have been conducted earlier in 
the process. 

1 1 . Review of the internal reports for all responding 
states revealed that 19 agency and 5 school data 
files generated no error messages at all. The edit 
messages associated with a variable name having 
three or fewer characters, such as school or agency 
name, city name, or street name, were reported 
some 304 times for the agency and school data. 
Yet manual review of these reports indicated that 
all of these three-letter variable names were valid, 
or at least, that they were not apparently changed 
or corrected. 

12. The numerous reports generated by the post-edit 
appeared to identify issues which could, in many 
instances, have been resolved earlier in the 
processing and editing cycle. For the observed 
processing and editing cycle, apparently due to 
time and resource constraints, very little evaluative 
use was made of these reports. 

13. The general overall “lateness” of the reviewed 
survey cycle, particularly as it affected the 
subsequent survey year’s mailout, caused the 
processing for most states during the post-edit 
stage to be rather cursory. The primary focus at 
this phase in the survey cycle apparently was not 
one of edit, but simply to complete as final all 
remaining states’ data files. 

14. There was an alarmingly high non-response rate 
exhibited for both the data summary ( 30 percent) 
and the edit (65 percent) reports which were sent 
to the states for their review, correction, and 
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response. Only 20 states formally submitted initial 
data files, a data summary response, and an edit 
response. 

15. For the 1996-97 Nonfiscal CCD Surveys, of the 
data files submitted by the state coordinators, just 
over 60 percent for the agency universe and about 
30 percent for the school universe contained at 
least one error as generated by the CCD main edit 
program during the edit stage of the processing 
cycle. 

16. The extent to which the data were reviewed and 
corrected throughout the survey cycle by the 
respondents was very minimal. Overall, less than 
one in five of all in-error records was sent to the 
respondents for review. Less than one-half of the 
respondents were provided the opportunity to 
review all of their agency records which generated 
errors during the edit phase, while only 20 percent 
of the respondents were provided this opportunity 
to review all of their error-filled school records. 
The number of identifiable corrections based on 
review of state responses for the edit stage revealed 
a minuscule overall survey average correction rate 
of 0.3 percent. 

Chapter 4. CCD Main Edit Program Edits and 
Related Error and Warning 
Messages 

17. The CCD main edit program edits performed three 
types of data checks: relational comparisons, data 
validation, and historical comparisons. The first 
group accounted for slightly more than half of all 
the generated error messages, while the validation 
edits represented more than 50 percent of the total 
edits themselves. 

18. The agency and school universe data record files 
submitted by the state data coordinators for the 
1996-97 Nonfiscal CCD Surveys contained a 
combined total of 72,819 error messages generated 
by 88 CCD main edit program edits. For the 
agency survey, 38 percent of the agency data 
records (agencies) generated no error messages 
while about 55 percent reported three or fewer. For 
the school survey, almost 70 percent of the schools 
generated no error messages while nearly all the 
remaining 30 percent generated 6 or fewer. 

19. Close to 92 percent of the error/waming messages 
applied to the basic agency and school statistics 
themselves (i.e., variables associated with student 
and staffing counts), with two edits, those 



involving the comparison of current and prior year 
pupil/teacher ratio counts on both surveys, 
accounting for almost one-fifth of all error 
messages. Administrative information data 
elements (name, address, etc.) accounted for 
virtually all the remaining error messages, as those 
data elements involving the code classification- 
related edits (agency type or school operational 
status codes, for example) accounted for only 
between 0.3 and 0.4 percent of all errors. 

20. In some cases, the error and warning messages 
tabulated and evaluated for this report were based 
on data submitted by the state CCD coordinators 
which had been previously processed through the 
Edit System software system provided to them to 
assist in their data reporting. For survey cycle 
1996-97, thirty of 56 responding states used the 
provided Edit System software. Other states may 
have used their own software for such pre- 
submission editing purposes. Thus, in some 
instances, the evaluated data had already received 
at least one level of review prior to its submission. 
Consequently, it was not entirely possible to 
review the effectiveness of the CCD main edit 
program edits on the raw input data at the state 
level. 

2 1 . This evaluation did not find overwhelmingly strong 
evidence to support the assumption that the states 
which submitted data files after using the CCD 
Edit System software would have “cleaner” data 
files (i.e., more accurate and reliable data) and, 
hence, fewer errors and lower error rates. While 
the initial agency data files of states using the Edit 
System software exhibited about a two-thirds of an 
error per record less than those not using the 
system, the difference for the school data files was 
a negligible 0.01 of an error per record. The 
percentage of in-error records was slightly more 
than 32 percent for the states using the Edit System 
software versus 41 percent for those not using it. 

Chapter 5. Effectiveness of the Nonfiscal CCD 

Surveys Edit Process 

22 . Comparing the number of CCD main edit program 
error/waming messages generated by the final data 
files to the initial files submitted by the states 
revealed only about a one-third overall reduction. 
The biggest decline in error and warning messages 
based on the final edits was in the historical edit 
category, which fell just over 40 percent. The 
smallest decline, for the agency data, was in 
relational edits, which dropped 1 5 percent. For the 
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school data, the validation edits, with a 25 percent 
reduction, exhibited the least decline. 

23. For the agency survey, when evaluated by state, 
half the responses (28) showed a reduction in error 
counts between initial submitted and final data of 
less than 10 percent. Nine states reported no 
difference between the initial and final data. Two 
states accounted for more than half of the total 
reduction. For the school survey data, four states 
accounted for over three-fourths of the overall 
reduction in error messages. Six states reported an 
increase in error/waming messages. 

24. When evaluated by edits, there were remarkable 
percentage differences between initial and final 
data files. For the surveys combined, the number of 
error messages generated by 35 (out of 82) edits 
declined by between 75 and 100 percent, 16 
declined between 25 and 74.9 percent, and 31 
declined less than 25 percent (including 2 that 
showed no change). Thirteen edits, however, 
actually generated more error messages from the 
final data files than from the initial data 
submissions. 

25. The edits demonstrating the largest percent 
changes initially produced the fewest error 
messages. The number of error messages generated 
by edits whose percent change was greater than 50 
percent accounted for only 15 percent of all error 
messages in the initial submissions. The 15 edits 
which had complete (100 percent) reduction in 
associated error messages accounted for less than 
5 percent of the initial total. The 33 edits whose 
percent change was less than 25 percent accounted 
for nearly two-thirds of all messages in the initial 
data submissions. 

26. Sixty-eight percent of the agency survey records 
and 37 percent of the school survey records 
initially submitted for the 1996-97 Nonfiscal CCD 
Surveys were in error. The vast majority (about 95 
percent) of these records contained three or fewer 
error/waming messages. Only 17 records, out of a 
possible 104,831 records, contained more than 12 
errors. 

27. The 12 most error-generating edits for both the 
agency and school surveys accounted for nearly 
two-thirds of all initial data error messages 
generated. These edits reported a reduction in error 
messages between the initial and final data below 
the overall rate of 30 percent. 
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28. The 23 edits which generated error messages 
because data were not provided (potentially either 
blank, missing, or otherwise invalid) accounted for 
almost one-quarter of all errors found in the initial 
submissions. The edits which checked data to 
determine acceptability in terms of falling within a 
preselected range/tolerance accounted for 60 
percent of the error messages. These edits 
demonstrated about a 25 percent reduction between 
initial and final data files. 

29. Eight selected national-level data element final 
counts showed moderate change (none more than 
15 percent) from initial data element counts. 

Chapter 6. Comparison of State Nonfiscal Data 

to Agency and School Universe Data 

30. The 13 data corrections made to the submitted data 
on the cross-file consistency report by the 
respondents represented a very small percentage 
(between 1 and 2 percent) of the data elements that 
were reviewed. 

3 1 . Respondent review and subsequent data editing for 
the CCD state nonfiscal data was quite limited. Of 
the 25 states for which verification of data was 
requested, only 48 verifiable data corrections or 
changes were made. Five states made no changes, 
while two states apparently did not respond to the 
request to verify their initial state nonfiscal data 
submission. 

32. In general, the data figures reported for all three 
surveys - the agency, school, and state nonfiscal - 
demonstrated very little difference in total value. 
When evaluated by state, the comparison between 
state nonfiscal and agency universe data category 
average difference varied by about seven percent 
for the initial data submissions, down to near three 
percent for the final data files. Comparison 
between state nonfiscal data and school universe 
showed average state percent variation to be 2.62 
percent for initial data, down a full one percent for 
the final data. 

33. When evaluated by the data categories compared 
between the state nonfiscal and agency surveys, the 
final data totals showed a great deal of variation in 
the amount difference. Five of the 21 categories 
reported an improvement in data match of greater 
than 90 percent, while four data category totals 
compared between the two surveys showed 
increased variation between the initial data 
submissions and the final data files. For the state 
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nonfiscal and school surveys, all compared data 
categories demonstrated a reduction in the amount 
of difference between the two files. Five of 21 data 
categories had their total value come closer 
together by more than 70 percent. 

34. Almost three-fourths of the variation or difference 
in data figures between the state nonfiscal survey 
and the two universe surveys was eliminated 
between the initial and final data files. This 
suggested reliable, comparable data across all three 
surveys. 

Section 1.2 Principal Recommendations 

Listed below is a summary of the primary 
recommendations specifically for the 1996-97 
Nonfiscal CCD Surveys data collection, processing, and 
editing cycle. It is recognized that a few of the 
suggestions made herein, to varying degrees, are being 
considered for inclusion into the processing and editing 
rework currently taking place for the expanded CCD 
surveys in 1998-99. 

1. Consideration should be given to the issue of the 
length of the CCD survey cycle time frame and the 
implications this has on the timeliness of the 
current year’s completion and subsequent year’s 
survey cycle commencement. All allotted response 
time interval lengths should be reviewed for 
sufficiency and appropriateness. 

2. NCES or its agent should shorten the time taken to 
notify the state CCD coordinator that a data 
submission response has not been received by a 
certain scheduled due date. It seems crucial that 
non-response follow-up be improved. It is 
recommended that, since delinquent response 
contributes significantly to the overall delay in 
processing and given the very high non-response 
rates associated with these surveys, the state 
coordinators be notified immediately on a flow 
basis when a data response due date is past (or 
approaching). Such notification would likely have 
the effect of improving survey timeliness and data 
response rates as well. 

3. Establish a concrete, adhered to “deadline” date for 
accepting initial data submissions and any 
resubmitted data. This would avoid an indefinite 
period of time in which data would be accepted. 
This event clearly extended the processing and 
overall survey cycle completion time of the 
reviewed cycle. This deadline date should be 



printed in the survey instructions manual which is 
part of the initial mailout materials and be part of 
any follow-up efforts to elicit state data response. 

4. To improve (i.e., shorten) the length of the survey 
cycle, it is further recommended that collection 
agent’s processing of submitted data be 
consistently initiated in a timely manner. This 
should be accomplished, to the extent possible, on 
a flow basis as the state submissions are received 
by NCES or its collection agent. 

5. Given the very low survey follow up response and 
error-correction rates along with the condition that 
many error corrections were apparently initiated 
and addressed by NCES/agent, the efficacy of the 
existing post-submission edit and review process is 
brought into question. A radical approach to 
revising this process would involve revamping the 
edit cycle to eliminate (or significantly reduce), as 
much as possible, the procedure of returning edit 
materials/reports back to the states for their review. 
Such action would more formally place the burden 
and responsibility of data editing on NCES and its 
agent. This is to a large extent, however, what 
occurs anyway. 

6. Other, less radical, recommendations would 
include adjustments to the current procedures. 
Several of these recommendations relate directly to 
the physical layout/presentation of the current data 
summary report. Alternative format suggestions 
include: 

a. Provide more clear and detailed descriptions 
of what is expected of the respondent in terms 
of reviewing and correcting the data presented 
in this report, including highlighting the due 
date, directly on the report itself. 

b. Delete the “five smallest and five largest 
values” headings and data for all data 
categories from the report. 

c. Place current year data and prior year data 
side-by-side and arrange dropout data totals in 
a tabular form (less the five smallest/largest 
data categories) to enhance ease of data 
comparison. 

d. For the school universe report, add a heading 
- “OPERATIONAL STATUS” - above the 
listing of schools (new, closed, etc.) 
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e. For the agency universe report, add a heading 
- “BOUNDARY STATUS” - above the listed 
LEA data categories. 

7. More clearly highlight the allotted response time 
interval requested for state response, perhaps 
specifying an actual due date, in the instructions at 
the top of the match report. 

8. Add an edit into the Edit System software program 
to compare assigned state and NCES identification 
(ID) numbers. This would require that the database 
listing of previously assigned ID numbers be 
provided with the initial reporting materials, but 
would eliminate the identification conflict 
“impossibilities” (such as a state education agency 
ID number being associated with more than one 
NCES education agency ID number on the school 
file) that appeared on the match report, often 
requiring resolution by the respondent and 
resulting in substantial processing time delays. 

9. Provide respondents with capability, when 
necessary, to assign their own new ID numbers. 
This could, among other possibilities, be 
accomplished by: 

a. Modifying Edit System software to generate 
new NCES agency and school ID numbers 
from the ALLLEAID and ALLSCHNO data 
files (the database files from which new ID 
numbers are assigned) as states add new 
agencies or schools to their survey universes. 

b. Providing states some level of access to the 
ALLLEAID and ALLSCHNO data files 
directly via the internet. 

10. Perform the internal report “edit” earlier in the 
editing and processing cycle. This would provide 
a barometer of the quality of a state’s submission 
before further editing commences. Any potential 
data issues might be identified and addressed 
sooner in the process, perhaps included as part of 
the data summary program and report mailout 
stage, thereby eliminating the current practice of 
having to repeatedly contact respondents. 

11. Modify the validity edits in the internal report 
program (similar to all subsequent edit programs) 
that examine identifying information data, like 
agency or school name, city name, or street name. 
It is recommended that the defining criteria be 
changed to identify responses having two 
characters or less rather than three characters or 



less. Although these certainly are not critical edits, 
this change would eliminate many of the error 
messages that state and federal reviewers and 
analysts must filter. 

12. Replace the existing edit reports (which consist of 
the top 50 agency and top 100 school error- filled 
records) with an edit “summary report.” It is 
recommended that such a report indicate the record 
(agency or school) ID number, the data element 
response in question, the error type (critical or 
warning), and the error message generated for all 
in-error records. This action would accomplish two 
important feats: 



a. Reduce the volume (and length) of edit 
materials requiring review that would be sent 
back out to the states, thus reducing 
respondent burden and likely improving 
response rates. 

b. Ensure that aH in-error records (and individual 
errors) would be available for respondent 
review. 



13. In order to make more productive use of the post- 
edit stage, consideration should be given to 
thoroughly reexamining the 28 generated post- 
edit summary reports for their intended purpose, 
function, and usefulness, as a component of the 
processing and editing cycle. 



14. Effort should continue to be expended towards 
urging more state CCD coordinators to use the 
Edit System software and other internet functions 
made available to them for data collection and 
initial data file preparation and submission. Such 
effort could be made at the annual data 
conference training sessions, via the internet, 
and/or in communications (letter, telephone, fax, 
etc.) with individual state data coordinators. 
Based on the findings of this evaluation, at least 
moderate overall improvement in survey data 
quality could be realized if more states used the 
Edit System diskette when preparing and 
reporting their initial data submissions. 



15. 



18 



All edits (mostly relational) containing 
“acceptable” range/tolerance parameters (e.g., 
current year data value compared to prior year 
data value exceeded a ±25 percent difference) 
should be reevaluated for appropriateness and 
effectiveness. Some edit tolerances, for example, 
might include an absolute number change 
criterion or perhaps a threshold of comparison 
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could be employed (e.g., if a school has 25 or 
fewer students then some edits would be 
suppressed) for some edits. This would ensure a 
more realistic and useful data criterion “check” 
aimed at identifying genuine data errors and 
outliers while at the same time preventing 
excessive erroneous data failures from being 
generated. Specific recommendations for 
individual edits are found in Chapter 5. 

16. As suggested in previous survey evaluations, 
consideration should be given to filling missing or 
erroneous ZIP code data using commercially 
available software. This function possibly could 
be included in the Edit System software revision 
planned for the upcoming CCD expansion. 
Although this data element is not crucial, this 
would eliminate the need for further reviewer and 
analyst attention. 

17. Consideration should be given to adding a 
“remarks” field to the Edit System software and to 
state’s data base file diskettes which are sent out 
in the initial mailout. Such a memo field would 
allow for the recording of pertinent comments and 
explanations regarding data features or anomalies. 
This would likely reduce the need for follow-up 
requiring contact by NCES or its collection 
agency with the respondent which inevitably 
lengthens the data processing time. 

18. Incorporate the “State Nonfiscal Two Year 
Consistency” report and the “Cross-file 
Consistency” report into one report, highlighting 
the data which the respondents are requested to 
review or verify (all data exhibiting a 10 percent 
difference between prior and current years, for 
example). This action would not only reduce the 
redundancies of checking certain data more than 
once, but also would potentially reduce the 
number of times a state coordinator is queried 
about his/her data. A possible shortcoming is that 
such action still requires all three data files (state, 
school, and agency) to have been received and 
processed up to a certain point. 
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Table 1-1. Summary of Relevant Timings and Error/Warning Message Rates for 1996-97 Nonfiscal CCD Surveys 


This table highlights several relevant processing and editing timings and error rates for data submined in the 1996-97 Nonfiscal CCD 








Surveys. Note that all timings are in weeks. 












Relevant Survey Timings* 


Agency Universe* 


School Universe* 
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Total 


No. of 


%of 


% of 


% diff- 
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%of 
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sub- 


of initial 


cycle 


times data 


in- 


record 


erence in 


error 


record 


erence in 




mission 


sub- 


time 


resub- 


error 


errors 


no. of 


records 


errors 


no. of 




response 


missions 




mitted 


records 


corrected 


errors 




corrected 


errors 


Total/ Average. 


15 


14 


50 


28 


62.4 


0.3 


-28.5 


30.8 


0.3 


-30.2 


Alabama 


30 


30 


48 


0 


16.0 


0.0 


-9.8 


13.3 


0.0 


-10.2 


Alaska 


21 


18 


50 


3 


43.6 


- 


-74.7 


34.3 


_ 


-5.8 


Arizona 


23 


20 


58 


0 


59.9 


- 


-25.9 


24.7 




-28.5 


Arkansas 


26 


28 


46 


0 


26.8 


8.4 


40.3 


9.5 


53.9 


-58.9 


California 


12 


14 


50 


1 


75.0 




-82.6 


20.2 


_ 


-8.3 


Colorado 


3 


14 


43 


1 


25.8 


- 


-14.5 


21.0 




-40.6 


Connecticut 


32 


28 


51 


0 


27.9 


- 


3.8 


12.0 




-16.5 


Delaware 


6 


4 


50 


0 


100.0 


2.2 


-50.0 


23.9 


3.9 


-12.6 


Dis. of Columbia 


23 


20 


50 


0 


100.0 


- 


0.0 


54.0 




-2.0 


Florida 


6 


3 


50 


0 


36.5 


■_ 


-7.0 


22.3 


_ 


-16.7 


Georgia 


14 


11 


50 


2 


20.2 


- 


10.3 


23.8 




-8.7 


Hawaii 


35 


32 


50 


0 


100.0 


- 


-100.0 


16.9 


_ 


-26.3 


Idaho 


2 


0 


50 


0 


16.8 


- 


0.0 


98.3 


_ 


-3.7 


Illinois 


32 


29 


50 


0 


82.6 


- 


-2.3 


14.1 




-17.0 


Indiana 


15 


15 


48 


0 


19.6 


_ 


-5.9 


11.4 


. 


-5.7 


Iowa 


5 


2 


50 


1 


48.0 




0.0 


14.4 


_ 


-1.8 


Kansas 


33 


32 


50 


0 


31.9 


0.0 


0.0 


11.8 


0.0 


-7.4 


Kentucky 


34 


31 


52 


0 


100.0 


- 


-35.8 


15.3 


_ 


-41.2 


Louisiana 


25 


22 


52 


3 


44.4 


_ 


-5.8 


12.0 


_ 


-8.2 


Maine 


4 


.2 


50 


0 


67.2 


0.0 


-0.7 


14.8 


0.0 


-2.4 


Maryland 


9 


6 


50 


0 


37.5 


0.0 


0.0 


8.1 


0.0 


-18.8 


Massachusetts 


23 


20 


50 


0 


100.0 


- 


-23.5 


98.7 


_ 


-48.3 


Michigan 


16 


33 


34 


3 


100.0 


- 


-14.9 


23.6 


_ 


-24.9 


Minnesota 


30 


33 


52 


1 


86.1 


- 


-15.6 


49.2 


_ 


-15.8 


Mississippi 


9 


6 


50 


0 


48.8 


2.8 


-5.4 


23.0 


1.4 


-9.8 


Missouri 


7 


3 


50 


0 


22.4 




-13.1 


18.3 




-8.8 


Montana 


7 


5 


50 


1 


50.3 


- 


-5.0 


25.9 


_ 


-4.2 


Nebraska 


4 


1 


50 


0 


50.4 


1.6 


-11.7 


36.4 


0.0 


-2.8 


Nevada 


8 


4 


50 


0 


38.9 


0.0 


-5.6 


20.5 


1.2 


-5.1 


New Hampshire 


4 


0 


50 


0 


100.0 


_ 


-22.7 


15.9 




-51.5 


New Jersey** 


- 


- 


- 


- 


- 


- 


. 


_ 


_ 




New Mexico 


6 


3 


50 


0 


27.0 


32.1 


-41.7 


9.4 


2.0 


-2.0 


New York 


25 


27 


49 


1 


41.9 


0.5 


-78.1 


13.0 


_ 


-89.0 


North Carolina 


12 


10 


50 


0 


82.9 


- 


0.0 


8.1 


_ 


-11.8 


North Dakota 


4 


1 


50 


0 


25.6 


0.0 


-0.8 


24.1 


0.0 


-20.9 


Ohio 


15 


15 


48 


2 


98.2 


_ 


-25.8 


15.8 




^.0 


Oklahoma 


26 


29 


46 


0 


99.8 


- 


-3.4 


14.8 


_ 


-9.4 


Oregon 


11 


8 


56 


0 


24.9 


- 


-44.9 


14.4 


_ 


-5.5 


Pennsylvania 


9 


6 


50 


0 


19.0 


0.0 


*1.4 


9.8 


0.0 


-5.3 


Rhode Island 


14 


11 


52 


2 


21.6 


0.0 


0.0 


22.5 


1.0 


-5.7 


South Carolina 


3 


0 


51 


0 


26.4 


20.0 


-25.0 


15.6 


1.1 


-5.6 


South Dakota 


4 


1 


50 


0 


39.3 


0.0 


-1.7 


31.8 


0.0 


-21.7 


Tennessee 


17 


27 


55 


2 


100.0 


- 


-30.4 


98.9 


_ 


-48.1 


Texas 


10 


7 


50 


1 


99.9 


- 


-7.9 


98.1 


_ 


-3.2 


Utah 


4 


2 


50 


0 


83.0 


0.0 


-22.8 


10.3 


3.0 


-38.5 


Vermont 


36 


33 


50 


0 


39.9 


- 


-17.4 


37.8 




-21.2 


Virginia 


15 


12 


50 


2 


100.0 


. 


-25.7 


98.1 


_ 


^.1 


Washington 


5 


7 


50 


0 


100.0 


- 


-10.6 


25.1 


_ 


2.1 


West Virginia 


13 


10 


50 


0 


31.6 


0.0 


-3.4 


15.1 


0.0 


-39.6 


Wisconsin 


23 


20 


50 


0 


14.6 


- 


-16.2 


11.2 


_ 


-17.6 


Wyoming 


5 


3 


50 


1 


31.0 


- 


12.1 


19.9 


_ 


-12.6 


Dept, of Defense 


35 


32 


50 


0 


100.0 


- 


-38.6 


95.4 


_ 


-66.5 


American Samoa 


4 


1 


50 


0 


100.0 


- 


-100.0 


100.0 


_ 


-14.7 


Guam 


3 


0 


50 


1 


100.0 


- 


-93.5 


45.7 


_ 


42.1 


North. Marianas 


31 


28 


50 


0 


100.0 


- 


0.0 


50.0 


_ 


-8.1 


Puerto Rico 


12 


15 


45 


0 


100.0 


100.0 


-75.0 


47.2 


3.9 


-80.7 


Virgin Islands 


4 


1 


50 


0 


100.0 


0.0 


0.0 


14.3 


27.3 


-15.4 


Notes: *The number of resubmissions is a total figure - all other figures in the first row are national averages. 








The percentage of in -error records and the percentage of record errors corrected are from submitted data at the edit stage of the 






cycle; the percent difference in number of generated error messages is the difference between the initial and final data files. 






"New Jersey did not submit any data files for 1996-97. 
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CHAPTER 2. THE DATA COLLECTION, 
PROCESSING, AND EDITING 
CYCLE 



Section 2.0 Introduction 

The purpose of evaluating the data collection, 
processing, and editing cycle was to determine whether 
the chronology of the nonfiscal CCD surveys could 
have any impact on data quality and the overall survey 
timeliness. The scope of this evaluation was from initial 
“mailout” of survey materials through “closeout” and 
delivery of all states’ final data files to NCES for CCD 
survey year 1996-97. No processing, editing, or 
respondent activity beyond 30 April 1998 was included 
in this report. This evaluation did not review any aspect 
of processing and editing done after delivery of final 
data files to the NCES. Nor did it review any associated 
final statistical products or publications of the survey. 

The Nonfiscal Common Core of Data Surveys are 
conducted annually. The content of the surveys is 
determined by the National Center for Education 
Statistics (NCES) and the participants with a stated 
objective to report on the condition of public 
elementary and secondary education in the United 
States. Typically, the surveys are completed from 
administrative records of the state education agencies 
by state CCD coordinators who are designated by their 
chief state school officers as official state liaisons with 
the NCES. 

The data collection proceeded via a mailout of the 
reporting instruction manual, software, and related data 
files to the state CCD coordinators, who in turn were 
responsible for the actual collection of data from their 
education agencies and schools. 

Section 2.1 The 1996-97 CCD Data Collection Cycle 

Review of recent survey years showed that the cycle for 
the 1996-97 nonfiscal surveys was not atypical of 
earlier censuses and that the data collection and 
processing was similar to the previous year’s survey. 
The CCD reporting materials were sent to the state 
CCD coordinator in each state. The CCD survey 
materials included separate prior year survey data 
information for each of the three surveys provided in 
the states’ preferred reporting format (electronic, 
shuttle, etc.), an edit software package designed to 
assist respondents with completing and editing of data 
files prior to initial submission, and a comprehensive 
reporting instructions manual. While the methods used 



by the states to collect their own education agency and 
school data vary, all survey responses must be certified 
by the state CCD coordinator as the responsible 
individual for confirming data availability and 
accuracy. 

For the 1996-97 Nonfiscal CCD Surveys - agency, 
school, and state nonfiscal surveys - the targeted date 
for initial mailout was 15 January 1997. However, as 
the result of delays in completing the previous year’s 
survey cycle, initial mailout did not commence until 23 
February 1997 with mailing of materials to 43 states. 
The remaining 14 states were mailed initial materials 
periodically over the next several months as previous 
year’s unresolved issues were resolved. The last initial 
mailout of materials did not occur until 5 June 1997. 
Table 2-1 shows actual mailout dates for all 57 states. 

Each state submitted its agency, school, and state 
nonfiscal data to NCES or the collection agent in three 
separate, complete data files. State CCD coordinators 
had the option of submitting their data electronically on 
diskette or the Internet, or manually on a hard copy 
document referred to as a “shuttle”. Shuttles were sent 
to state data coordinators for verification or correction 
of identifying or administrative information, as well as 
for the addition of new statistical data. 

The stated due date for all three survey data files in the 
completion instruction manual for 1996-97 was 15 
March 1997. This date was not modified in most cases 
as a result of the delayed initial mailout dates. Thus, for 
a majority of the states the actual time interval between 
the mailout of the reporting materials and the targeted 
due date was only about three weeks rather than the 
intended eight weeks. However, for those states which 
reporting materials were sent out to after the due date of 
15 March, the revised due date was effectively five or 
six weeks after the actual date of mail out. 

While the scheduled time interval between initial 
mailout and the data file due date of eight weeks 
represented a relatively short response time, it was not 
found to be a major concern for several reasons. First, 
the states collect basic elementary and secondary 
education statistics and information for their own 
purposes which meant that limited research was 
required to respond to the surveys. In some instances, 
however, the timing of this data collection may be long 
after CCD due dates 1 . Second, the reporting 



[ NCES held a focus group discussion with 
several state CCD coordinators in July 1997 which focused 
on the issues of CCD timeliness and data submission 
deadlines. Some states indicated that they could not ensure 
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requirements have up to this point remained rather 
consistent, changing only slightly, if at all, each year. 
Third, state CCD coordinators were typically notified 
well in advance of any anticipated change or 
modification in the data elements which were to be 
collected and reported. 

When examining the nonfiscal CCD survey cycle for 
timing implications it was instructive to consider the 
respondent response time intervals for their initial 
response. That is, the time elapsed between initial 
mailout of reporting materials for the 1996-97 
Nonfiscal CCD Surveys and submission of agency 
universe, school universe, and state nonfiscal data files 
by the states. 

As the following chart and Table 2-2 at the end of this 
chapter indicate, there was a great deal of variance in 
the submission timings of initial data files, with only 
two states meeting the targeted due date: 



CCD data files 
received by 


Initial data submission 


Agency 


School 


State 

non- 

fiscal 


Total* 


56 


56 


55 


March 15, 1997** 


2 


2 


2 


March 31, 1997 


11 


10 


10 


April 30, 1997 


12 


12 


10 


May 31, 1997 


5 


5 


4 


June 30, 1997 


7 


7 


4 


July 31, 1997 


4 


4 


5 


August 31, 1997 . . . 


2 


3 


5 


September 30, 1 997 


4 


4 


5 


October 31, 1997 . . 


8 


8 


8 


November 30, 1997 


1 


1 


2 


December 31, 1997 


0 


0 


0 



*New Jersey did not submit any data files for 1996- 
97; DOD did not submit a state nonfiscal data file. 
**The “due” date for respondent data submissions. 



LEAs reported data to them by the CCD due data of 15 
March. Others indicated that their states have different due 
date timetables for various data elements. 



Follow-up with the state coordinator regarding late data 
file submissions was somewhat limited. For late 
respondents, a letter or fax was sent, or telephone call 
was placed to inquire about the status of the state’s 
submission as well as to remind them of the due date. 
However, as evident from review of the initial 
submission dates, there was a chronic lateness to most 
of these submissions. 

For the reviewed survey cycle, the average response 
time for initial data file submission was about double 
the eight weeks allotted for in the target schedule. That 
is, about 15 weeks for the agency/school files (these 
were not considered submitted until both files had been 
received because existing procedures require both files 
for further processing and editing to occur) and about 
16 weeks for the state nonfiscal data files. The range of 
response time for agency/school files varied between 
two and 36 weeks and between two and 39 weeks for 
the state nonfiscal data files. Less than half of the states, 
21 and 20, respectively, for agency/school files and 
state nonfiscal files, submitted their initial data files 
within the allocated schedule time of eight weeks. 
Fourteen states took 30 or more weeks to initially 
submit all three data files. Table 2-1 shows initial 
response time intervals for all states. 

Section 2.2 The 1996-97 CCD Data Processing 
and Editing Cycle 

Data processing and editing refers to the combined 
activities of review, correction, and edit of the data files 
submitted by state CCD coordinators. These activities 
included the “processing” functions carried out by the 
NCES and/or its designated agent as well the 
“response” functions conducted by the respondent 
states. 

For purposes of this evaluation, the agency universe and 
the school universe surveys, due to the inherent link 
between the data collected and reported for each 
survey, were for the most part evaluated together as a 
unit separate from the state nonfiscal survey. However, 
because of the very limited processing and editing done 
on the state nonfiscal data, this phase of the evaluation 
included that survey with the other two surveys. Also, 
since the focus of this chapter is on response and 
processing time intervals and their implications for data 
quality and overall survey timeliness, inclusion of the 
state nonfiscal seemed appropriate. Thus, the data 
processing and editing cycle for all three surveys will 
be reviewed in this section. More detailed coverage will 
appear in Chapters 3 and 4 for the agency and school 

22 
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surveys, while Chapter 6 will expand on the state 
nonfiscal survey. 

The processing and editing cycle for the 1996-97 CCD 
Agency and School Universe Surveys can be 
characterized as having five stages or phases. These 
stages, which to a large extent correspond to the SAS- 
based software programs used to review and edit data, 
include: data summary, ID assignment, internal report, 
main edit, and post-edit. While a detailed description 
and evaluation of these stages appear in the next 
chapter, the primary emphasis in this section was to 
assess the components of and lengths of identifiable 
time intervals which combined to make up the total 
processing and editing time cycle for the 1996-97 CCD 
Nonfiscal Surveys. 

In addition to the initial mailout of reporting materials 
requesting initial state data submissions, there were two 
subsequent mailouts, at the data summary and edit 
phases in the cycle, which requested review and 
correction of previously submitted data on the part of 
the respondent. Table 2-3 shows the amount of time 
taken by the states to respond with comments or 
corrections at both the data summary and the edit 
stages. The average state response time to the data 
summary report was almost five weeks and for the edit 
report response, six weeks. In both instances, the states 
were requested to respond within two weeks. Note that 
the respondent response time interval for the data 
summary had a range of one day (typically a response 
by e-mail or fax) to 17 weeks. This interval for the edit 
stage ranged between one and 21 weeks. 

These timings were critical to the overall process in 
that, in most cases, further processing activity was 
contingent upon receiving a response to these reports 
from the states. Stated differently, this time represented 
a period of time when the NCES or its agent were 
awaiting response and, thus, not fully capable of 
processing data files. Table 2-4 shows that the average 
total respondent response time, for the 20 states that 
submitted an initial data file, a data summary response, 
and an edit response, was about 22 weeks, with a range 
of 8 to 42 weeks. 

The other timing component, internal NCES/agent 
processing time, of the overall processing and editing 
cycle is shown in Table 2-5. The intent of this table 
was to highlight two distinct components of the 
nonfiscal CCD survey cycle when, in practice, the 
burden of progressing towards completion of 
processing and editing activities lay with the 
NCES/agent. The first processing interval depicted the 
time between receipt of the agency and school data files - 



(both of which must be received to generate the data 
summary report) and the mailout of the data summary 
report. For the cycle reviewed, the time taken to process 
the initial data files for data summary mailout took, on 
average, exactly nine weeks. 

A second processing interval displayed in this table, 
which is not additive to the first, was the time taken 
from receipt of the state nonfiscal data file to mailout of 
the edit report. This mailing was not contingent upon 
receipt of a data summary report. However, the state 
nonfiscal data file must have been received in order to 
generate a cross-file consistency report which was 
mailed to the states as part of the edit report. The 
average time between these two points in the process 
was about 23 weeks. 

It was clearly noted that in many instances these 
processing time intervals included time when the NCES 
or agent staff were awaiting a response to, or 
clarification of, an issue deemed critical for resumption 
of processing. This evaluation observed there to be no 
clear distinction between NCES/agent “processing and 
editing” time and the respondent “response” time. Thus, 
the total survey cycle time depicted in Table 2-4 cannot 
simply be divided into the two distinct time intervals of 
response and processing. 

The important role and effect that the various 
respondent response times and internal processing time 
had on the overall length of the CCD survey cycle was, 
however, more evident. These timing implications are 
addressed in the following section. 

Section 23 Timing Implications 

This phase of the evaluation examined the data 
processing and editing cycle for the 1996-97 Nonfiscal 
CCD Surveys. This section focused on the surveys 
from the perspective of the total survey cycle 
completion time, including the processing/editing and 
response timings, and the resultant implications. 

Table 2-4, among other relevant and important aspects 
of the reviewed surveys, shows that, on average, initial 
data file submission by the respondents was almost 
three and a half months, or 14 weeks, beyond the due 
date of 15 March 1997 regardless of the actual mailout 
date. In fact, slightly more than one-third of the 
respondents were as many as 4 months ( 1 6 weeks) late 
in submitting their initial agency or school universe data 
files. A timely survey cycle was apparently jeopardized 
from the beginning as a result of delinquent submission 
of initial data files by the states. 
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The total allocated respondent response time of four 
weeks (2 weeks for each phase) for the data summary 
and edit stages along with the combined average 
response time for these two phases of almost 1 1 weeks 
(shown in Table 2-3) meant an additional delay of 7 
weeks. Thus, amount of time that was attributable to 
late responses by the states, averaged about 21 weeks 2 
total when considering the 1996-97 Nonfiscal CCD 
Surveys scheduled time allocated for these activities. A 
question that needed to be asked: Were these scheduled 
response time intervals for these activities 
unreasonable, or could these five months of delays have 
been eliminated simply by states responding within the 
allotted time frame? Even if adjustments were made to 
lengthen allocated response-time intervals, there are 
apparent time savings associated with response timings 
such as electronic follow-up responses by the states 
which could shave several weeks from the overall 
response time. In any event, the issue was critical to a 
timely survey cycle. 

Table 2-4 reveals that the total survey cycle time, that 
is the time elapsed from initial mailout to final data file 
completion, for each state in the 1996-97 Nonfiscal 
CCD Surveys averaged just under 1 year at about 50 
weeks. However, the elapsed time from the first states’ 
initial reporting material mailout to the last states’ data 
file being finalized - the longest total survey cycle time 
for any one state - was 58 weeks. The shortest interval 
for any state was 34 weeks. 

In terms of evaluating the overall survey processing and 
editing cycle duration (total time from initial mailout to 
complete final data file closeout) for the 1996-97 
Nonfiscal CCD Surveys, the response and processing 
timings discussed in this chapter had several 
consequences: 

1. Delayed the commencement of initial data file 
processing and editing. 

2. Compressed the time available for data review 
and correction, particularly in the latter stages of 
the cycle such as the post-edit stage. 

3. State data coordinators were queried about their 
data, in most cases, many weeks after the original 
submissions. This practice had the potential for 
making follow-up inquiries more difficult because 
of excessive time lapse. 



2 

Included the almost 14 weeks attributable to 
late initial data file submissions and the 7 weeks, 3 weeks 
for the data summary response and 4 weeks for the edit 
response, associated with late state responses. 



4. Delayed public release file of data and NCES 
publications that use the data. 

5. Ultimately, delayed the subsequent year’s mailout 
date and entire survey cycle. 

Section 2.4 Impact of Resubmissions on Data 
Quality and Timeliness 

Another remarkable aspect of this cycle was the large 
number of states that resubmitted data at some point 
during the processing and editing cycle. During the 
evaluated survey cycle, 17 states provided 27, either 
partial or complete, revisions to their data. For the 
purposes of this evaluation, if a state resubmitted an 
entire agency or school data file, the “resubmission” 
was considered complete. Those resubmitted data 
which consisted of data related to a specific category, 
like dropout or staffing data for example, were 
considered to be partial resubmissions 

As Table 2-2 indicates, about half of the states that 
resubmitted did so more than once, some as many as 
three times during the survey cycle. The resubmissions 
were generally spread throughout the entire survey 
cycle and covered about one full year, with one state 
resubmitting data as early as April 1997 and one state 
as late as April 1998. While this table does not 
necessarily address the additional processing that was 
required due to resubmitted data files, it does 
demonstrate the rather significant amount of data that 
required some level of re-processing and re-editing. The 
number and frequency of data resubmissions carried 
both data quality and survey timeliness implications. 

Twelve of the 17 states that resubmitted data took 
longer than the national average of 49.8 weeks in total 
survey cycle completion time. The average total 
processing completion time for those states that 
resubmitted versus those that did not was 49.1 weeks 
compared to 50.2 weeks. While this one week 
differential is certainly not conclusive evidence of a 
detrimental impact of data resubmission during the 
nonfiscal CCD survey cycle, the issue of data 
resubmission, nonetheless, seemed to be relevant when 
considering survey cycle completion time. 

The necessity of having to re-process the same (revised) 
data more than once clearly contributed to redundancies 
and an overall diversion of effort and resources that 
otherwise might have been applied to further processing 
of other states’ data. Simply stated, time and resources 
spent on data resubmissions were essentially time and 
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resources not spent on processing other data and 
undoubtedly lengthened survey processing time. 



Section 2.5 Recommendations 

There are several recommendations associated with the 

response and processing timings of the data collection, 

processing, and editing described herein: 

1 . Careful consideration should be given to the issue 
of the length of the CCD survey cycle time frame 
and the implications this has on the timeliness of 
the current year’s completion and subsequent 
year’s survey cycle commencement. 

2. NCES or its agent should shorten the time taken 
to notify the state CCD coordinator that a data 
submission response has or has not been received 
by a certain scheduled due date. It is 
recommended that, since delinquent respondent 
responses contribute significantly to the overall 
delay in processing, the states be notified 
immediately on a flow basis when a data due date 
is past (or approaching). Such notification would 
likely have the effect of improving survey data 
request response rates as well. 

3. Establish a concrete, adhered to “deadline” date 
for accepting initial data submissions and any 
resubmitted data. This would avoid an indefinite 
period of time in which data would be accepted. 
This event clearly extended the processing and 
overall survey cycle completion time. This 
deadline date should be printed in the survey 
instructions manual which is part of the initial 
mailout materials. 

4. To improve (i.e., shorten) the length of the survey 
cycle, it is further recommended that collection 
agent’s processing of submitted data be 
consistently initiated in a timely manner. This 
should be accomplished, to the extent possible, on 
a flow basis as the state submissions are received 
by NCES or its collection agent. 
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Table 2-1. Response Time Interval from Initial Mailout to Receipt of Agency, School, and State Nonfiscal Data Files 

in 1996-97 Nonfiscal CCD Surveys 


This table shows the interval (in weeks) between initial mailout and the date the various data fdes were received l That is, it 


shows the initial response time interval. Note that the due date for data submission was 15 March 1997. 








Response Interval (in weeks) 


State 


Initial 


Agency 


School 


State Non- 


Agency/ 


State 




Mailout 


Received 


Received 


fiscal Rec’d. 


School* 


Nonfiscal 


All states, avg. 


- 


- 


. 


_ 


15 


16 


Alabama 


3/12/97 


4/01/97 


10/08/97 


10/08/97 


30 


30 


Alaska 


2/23/97 


7/17/97 


7/17/97 


7/17/97 


21 


21 


Arizona 


2/23/97 


7/30/97 


7/30/97 


7/30/97 


23 


23 


Arkansas 


4/02/97 


9/30/97 


9/30/97 


9/30/97 


26 


26 


California 


4/02/97 


6/20/97 


6/10/97 


7/23/97 


12 


17 


Colorado 


6/05/97 


6/23/97 


6/23/97 


6/24/97 


3 


3 


Connecticut 


2/23/97 


9/30/97 


4/28/97 


10/24/97 


32 


35 


Delaware 


2/23/97 


4/09/97 


4/09/97 


4/07/97 


6 


6 


Dis. of Columbia 


2/23/97 


7/30/97 


7/30/97 


7/30/97 


23 


23 


Florida 


2/23/97 


4/07/97 


4/07/97 


4/07/97 


6 


6 


Georgia 


2/23/97 


5/30/97 


5/30/97 


5/30/97 


14 


14 


Hawaii 


2/23/97 


10/23/97 


9/18/97 


9/18/97 


35 


30 


Idaho 


2/23/97 


3/10/97 


3/10/97 


8/04/97 


2 


23 


Illinois 


2/23/97 


10/02/97 


10/02/97 


11/19/97 


32 


39 


Indiana 


3/12/97 


6/25/97 


6/25/97 


10/30/97 


15 


33 


Iowa 


2/23/97 


3/31/97 


3/31/97 


3/31/97 


5 


5 


Kansas 


3/12/97 


10/24/97 


10/24/97 


10/23/97 


33 


33 


Kentucky 


2/23/97 


10/20/97 


10/20/97 


8/27/97 


34 


27 


Louisiana 


2/23/97 


8/14/97 


8/14/97 


10/30/97 


25 


35 


Maine 


7/23/91 


3/25/97 


3/25/97 


3/25/97 


4 


4 


Maryland 


2/23/97 


4/23/97 


4/23/91 


4/23/97 


9 


9 


Massachusetts 


2/23/97 


7/31/97 


7/31/97 


10/29/97 


23 


36 


Michigan 


7/14/97 


11/01/97 


11/01/97 


11/13/97 


16 


18 


Minnesota 


4/02/97 


10/31/97 


10/31/97 


7/30/97 


30 


17 


MississiDDi 


2/23/97 


4/28/97 


4/28/97 


4/28/97 


9 


9 


Missouri 


2/23/97 


4/08/97 


4/08/97 


4/16/97 


7 


8 


Montana 


2/23/97 


4/18/97 


4/18/97 


8/04/97 


7 


23' 


Nebraska 


2123/91 


3/24/97 


3/24/97 


3/24/97 


4 


4 


Nevada 


2/23/97 


4/15/97 


4/15/97 


4/15/97 


8 


8 


New Hampshire 


2123/91 


3/18/97 


3/18/97 


3/18/97 


4 


4 


New Jersey** 


4/03/97 


- 


- 


_ 




_ 


New Mexico 


2/23/97 


4/07/97 


4/07/97 


4/23/97 


6 


8 


New York 


4/03/97 


9/23/97 


9/23/97 


9/23/97 


25 


25 


North Carolina 


2/23/97 


5/19/97 


5/19/97 


5/20/97 


12 


12 


North Dakota 


2/23/97 


3/25/97 


3/25/97 


3/25/97 


4 


4 


Ohio 


3/12/97 


6/24/97 


6/24/97 


8/12/97 


15 


22 


Oklahoma 


4/03/97 


10/01/97 


10/01/97 


10/28/97 


26 


29 


Oregon 


2/23/97 


5/12/97 


5/12/97 


3/06/97 


11 


2 


Pennsylvania 


2/23/97 


4/23/97 


4/23/97 


4/23/97 


9 


9 


Rhode Island 


2/23/97 


6/03/97 


6/03/97 


6/03/97 


14 


14 


South Carolina 


2/23/97 


3/14/97 


3/14/97 


3/14/97 


3 


3 


South Dakota 


2/23/97 


3/19/97 


3/19/97 


3/19/97 


4 


4 


Tennessee 


2123/91 


9/19/97 


8/14/97 


9/24/97 


17 


18 


Texas 


2/23/97 


4/30/97 


4/30/97 


4/30/97 


10 


10 


Utah 


2123/91 


3/26/97 


3/26/97 


4/09/97 


4 


7 


Vermont 


2123/91 


10/31/97 


10/31/97 


9/04/97 


36 


28 


Virginia 


2123/91 


6/05/97 


6/05/97 


10/27/97 


15 


35 


Washington 


4/03/97 


5/05/97 


5/05/97 


5/19/97 


5 


7 


West Virginia 


2123/91 


5/21/97 


5/21/97 


5/21/97 


13 


13 


Wisconsin 


2123/91 


8/04/97 


8/04/97 


8/04/97 


23 


23 


Wyoming 


2123/91 


4/01/97 


4/01/97 


6/10/97 


5 


15 


Dept, of Defense** 


2123/91 


10/24/97 


10/24/97 


- 


35 


_ 


American Samoa 


2123/91 


3/21/97 


3/21/97 


3/21/97 


4 


4 


Guam 


2123/91 


3/18/97 


3/18/97 


3/18/97 


3 


3 


North. Marianas 


2123/91 


3/18/97 


9/24/97 


3/18/97 


31 


3 


Puerto Rico 


4/03/97 


6/23/97 


6/23/97 


6/23/97 


12 


12 


Virgin Islands 


2123/91 


3/24/97 


3/24/97 


3/24/97 


4 


4 



Notes: ^Response time interval is from initial mailout to the time of receipt of the latest file (agency or school). 
**New Jersey did nor submit any data files for 1996-97; Dob’ did not submit a state nonfiscal data file. 
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Table 2-2 


Summary of Initial Data File Submissions and Resubmissions by Month in 1996-97 Nonfiscal CCD Surveys 




This table shows the distribution by month of initial data file submissions and resubmissions during the 1996-97 Nonfiscal 

CCD Surveys data processing and editing cycle. 




Month of Initial Data Submission 1997 








Month of Data Resubmission 1997/1998 


State 


M 


A 


M 


J 


J 


A 


s 


O 


N 


A 


M 


J 


J 


A 


S 


o 


N 


D 


J 


F 


M 


A 




a 


P 


a 


u 


u 


u 


e 


c 


0 


P 


a 


u 


u 


u 


e 


c 


0 


e 


a 


e 


a 


p 




r 


r 


y 


n 


1 


g 


P 


t 


V 


r 


y 


n 


1 


g 


P 


t 


V 


c 


n 


b 


r 


r 


Total* 


37 


34 


14 


18 


13 


10 


13 


24 


4 


i 


i 


l 


4 


1 


4 


3 


4 


3 


3 


2 


0 


l 


Alabama 

Alaska 










/ 


A 




+ 














C 






C 








p 


Arizona 










/ 




































Arkansas 

California 








X 


St 




/ 












C 




















Colorado 

Connecticut 




S 




/ 






A 


St 










C 




















Delaware 
Dis. of Columbia 




/ 






/ 




































Florida 




✓ 










































Georgia 

Hawaii 

Idaho 


X 




/ 






St 


+ 


A 


















C 


c 










Illinois 
















X 


St 




























Indiana 








X 








St 






























Iowa 

Kansas 


/ 














/ 




C 


























Kentucky 












St 




X 






























Louisiana 

Maine 


/ 










X 




St 
















C 






C 


C 






Maryland 

Massachusetts 

Michigan 




/ 






X 






St 


/ 
















C 




C 


C 






Minnesota 

Mississippi 




/ 






St 






X 


















c 












Missouri 




/ 










































Montana 

Nebraska 


/ 


X 








St 


















P 
















Nevada 

New Hampshire 


/ 


/ 










































New Jersey** 
New Mexico 
New York 
North Carolina 
North Dakota 


/ 


/ 


/ 








/ 
















P 
















Ohio 

Oklahoma 








X 




St 




/ 










c 


c 


















Oregon 
Pennsylvania 
Rhode Island 


St 


/ 


X 


/ 




























c 


c 








South Carolina 


/ 












































South Dakota 
Tennessee 


/ 










s 


a 


















C 


p 












Texas 




/ 




























P 














Utah 


X 


St 










































Vermont 














St 


X 






























Virginia 
Washington 
West Virginia 
Wisconsin 


/ 




/ 


X 




/ 




St 










p 




P 
















Wyoming 




X 




St 














c 
























Dept, of Defense 
American Samoa 


/ 














X 






























Guam 


/ 






















C 






















North. Marianas 
Puerto Rico 


□ 






/ 






s 
































Virgin Islands 


/ 












































Notes: *Indicates the total number of data files (agency, school, or state nonfiscal), or partial/complete resubmissions, that were submitted 




**New Jersey did not submit any data files f 


or 1996-97. 
































Meaning of symbols: A : 


= Agency data file only 




/ = All three data files 








□ : 


= Agency and State data files 






s 


= School data file only 




) 


< = Agency and School data files 




c 


= complete resubmission 








St 


= State nonfiscal data file only 


t = School a 




ite non fiscal data files P : 


= partial resubmission 
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Table 2-3. Data Summary and Edit Phase Respondent Response Time Interval for Data Submission 

in 1996-97 Nonfiscal CCD Surveys 


This table shows the interval between mailout and receipt of data summary and edit reports. That is, it shows the respondent response time 
interval for the data summary and edit phases of the CCD processing cycle . 


State 


Data Summary 
Mailed 


Data Sum. 
Response 
Received 


Response 
Interval 
(in weeks)* 


Edit 

Mailed 


Edit Response 
Received 


Response 
Interval 
(in weeks)* 


All states, avg. 


- 


_ 


5 


_ 


_ 


6 


Alabama 


10/17/97 


10/31/97 


2 


10/24/97 


1 1/03/97 




1 


Alaska 


11/18/97 


1/05/98 


7 


12/17/97 


y 




_ 


Arizona 


8/06/97 


y 


- 


4/02/98 


y 




_ 


Arkansas 


10/22/97 


12/04/97 


6 


1/27/98 


2/17/98 




3 


California 


7/08/97 


7/23/97 


2 


3/24/98 


y 




_ 


Colorado 


2/24/98 


2/25/98 


1 day 


4/02/98 


y 




_ 


Connecticut 


1 1/04/97 


11/14/97 


2 


12/17/97 


y 




_ 


Delaware 


7/08/97 


9/25/97 


11 


1 1/25/97 


12/05/97 




2 


Dis. of Columbia 


1 1/20/97 


y 


- 


12/17/97 


y 




_ 


Florida 


5/20/97 


6/20/97 


4 


1/08/98 


y 




_ 


Georgia 


7/03/97 


9/09/97 


9 


9/22/97 


y 




_ 


Hawaii 


11/19/97 


y 


- 


12/17/97 


y 




_ 


Idaho 


5/20/97 


6/20/97 


4 


9/22/97 


y 




_ 


Illinois 


11/13/97 


y 


- 


1 1/25/97 


y 




_ 


Indiana 


9/23/97 


y 


- 


1 1/25/97 


y 




_ 


Iowa 


5/20/97 


6/20/97 


4 


9/22/97 


y 




_ 


Kansas 


11/05/97 


11/06/97 


1 day 


12/17/97 


1/15/98 




5 


Kentucky 


1 1/20/97 


y 


- 


2/18/97 


y 




. 


Louisiana 


1 1/05/97 


y 


- 


2/19/98 


y 




. 


Maine 


5/20/97 


7/28/97 


10 


9/22/97 


11/21/97 




9 


Maryland 


5/20/97 


6/20/97 


4 


11/25/97 


12/12/97 




3 


Massachusetts 


12/15/97 


y 


- 


12/17/97 


y 




. 


Michigan 


1/21/98 


1/22/98 


1 day 


3/12/98 


y 




- 


Minnesota 


1/12/98 


y 


- 


4/02/98 


y 




- 


Mississippi 


5/20/97 


8/11/97 


12 


9/22/97 


2/04/98 




21 


Missouri 


7/08/97 


y 


- 


12/17/97 


y 




_ 


Montana 


5/20/97 


6/20/97 


4 


9/22/97 


y 




_ 


Nebraska 


5/20/97 


6/09/97 


3 


9/22/97 


10/15/97 




5 


Nevada 


7/08/97 


7/28/97 


3 


11/25/97 


12/12/97 




3 


New Hampshire 


5/20/97 


9/15/97 


17 


1 1/25/97 


V 




_ 


New Jersey** 


- 


- 


- 


- 


- 






New Mexico 


5/20/97 


7/17/97 


9 


9/22/97 


10/29/97 




6 


New York 


1 1/18/97 


1 1/24/97 


1 


1/28/98 


3/24/98 




8 


North Carolina 


7/03/97 


7/31/97 


4 


9/22/97 


y 




_ 


North Dakota 


5/20/97 


7/07/97 


6 


9/22/97 


11/24/97 




10 


Ohio 


7/08/97 


y 


- 


12/17/97 


y 




_ 


Oklahoma 


11/18/97 


12/08/97 


3 


1/29/98 


y 




_ 


Oregon 


7/09/97 


y 


- 


3/23/98 


y 




. 


Pennsylvania 


5/20/97 


6/10/97 


3 


9/22/97 


10/10/97 




3 


Rhode Island 


10/16/97 


10/31/97 


2 


10/23/97 


10/31/97 




1 


South Carolina 


5/20/97 


6/20/97 


4 


9/22/97 


10/15/97 




4 


South Dakota 


5/20/97 


6/09/97 


3 


9/22/97 | 


10/06/97 




2 


Tennessee 


10/30/97 


1 1/06/97 


I 


2/19/98 


y 




_ 


Texas 


6/16/97 


7/17/97 


4 


12/17/97 


y 




_ 


Utah 


5/20/97 


6/20/97 


4 


9/22/97 


12/03/97 




11 


Vermont 


11/05/97 


12/22/97 


6 


12/23/97 


y 






Virginia 


6/16/97 


7/29/97 


6 


12/17/97 


y 




_ 


Washington 


11/19/97 


y 


- 


3/23/98 


y 






West Virginia 


6/16/97 


7/02/97 


2 


9/22/97 


10/21/97 




4 


Wisconsin 


10/16/97 


y 


- 


10/28/97 


y 




- 


Wyoming 


5/20/97 


8/12/97 


12 


1 1/07/97 


y 




- 


Dept, of Defense 


12/17/97 


y 


- 


12/17/97 


y 




- 


American Samoa 


7/08/97 


y 


- 


12/17/97 


y 






Guam 


5/20/97 


7/01/97 


6 


1 1/24/97 


y 




_ 


North. Marianas 


10/29/97 


12/18/97 


7 


12/17/97 


y 




_ 


Puerto Rico 


7/30/97 


7/31/97 


1 day 


10/15/97 


2/10/98 




17 


Virgin Islands 


5/20/97 


7/02/97 


2 


10/15/97 


10/24/97 




2 


Notes; * All time intervals measured in weeks, unless specified otherwise. 
**New Jersey did not submit any data files for 1996-97. 
y = no response received as of 30 April 1998. 
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Table 2-4. Relevant Findings and Cycle Timings for 1996-97 Nonfiscal CCD Surveys 


This table highlights several important findings for the 1996-97 CCD processing cycle . The total time component represents 
the time from initial mailout of data files to final closeout ( completion of post-edit stage) of state CCD data files . 


State 


Use Edit 
System 
Software 


Method of 
initial data file 
submission* 


Lateness of 
initial data 
file 

submission* 


Respondent 

Response 

Time 

(in weeks)** 


Initial 

Mailout 


Closeout 

(Post-edit 

Complete) 


Total 

Time 

(in weeks) 


All states, avg. 


- 




14 


22 




. 


50 


Alabama 


yes 


I, D 


30 


33 


3/12/97 


2/03/98 


48 


Alaska 


yes 


I 


18 


- 


2/23/97 


2/03/98 


50 


Arizona 


yes 


D 


20 


- 


2/23/97 


4/02/98 


58 


Arkansas 


yes 


D, S 


28 


35 


4/02/97 


2/18/98 


46 


California 


ves 


D. S 


14 


. 


4/02/97 


3/19/98 


50 


Colorado 


no 


I 


14 


- 


6/05/97 


3/31/98 


43 


Connecticut 


yes 


I,D 


28 


- 


2/23/97 


2/12/98 


51 


Delaware 


no 


S, D 


4 


19 


2 / 23/97 


2/03/98 


50 


Dist. of Columbia 


no 


D 


20 


- 


imm 


2/03/98 


50 


Florida 


ves 


D 


3 


- 


7mm 


2/03/98 


50 


Georgia 


no 


I 


11 


- 


imm 


2/04/98 


50 


Hawaii 


no 


S, D 


32 


- 


7mm 


2/03/98 


50 


Idaho 


no 


D, S 


0 


- 


imm 


2/03/98 


50 


Elinois 


no 


D 


29 


- 


7mm 


2/03/98 


50 


Indiana 


ves 


I.S 


15 


. 


3/12/97 


2/03/98 


48 


Iowa 


yes 


I,D 


2 


- 


7mm 


2/04/98 


50 


Kansas 


yes 


I,S 


32 


38 


3/12/97 


2/06/98 


50 


Kentucky 


no 


I 


31 


- 


7mm 


2/18/98 


52 


Louisiana 


yes 


I. D 


22 


- 


7mm 


2/19/98 


52 


Maine 


ves 


D 


2 


23 


7mm 


2/04/98 


50 


Maryland 


yes 


D 


6 


16 


7mm 


2/04/98 


50 


Massachusetts 


no 


D, S 


20 


- 


2/23/97 


2/04/98 


50 


Michigan 


no 


I 


33 


- 


7/14/97 


3/11/98 


34 


Minnesota 


yes 


D, S 


33 


- 


4/02/97 


4/02/98 


52 


Mississippi 


no 


D 


6 


42 


2/23/97 


2/06/98 


50 


Missouri 


yes 


I,D 


3 


- 


2/23/97 


2/04/98 


50 


Montana 


yes 


IS 


5 


- 


2/23/97 


2/04/98 


50 


Nebraska 


no 


D 


1 


12 


7mm 


2/04/98 


50 


Nevada 


yes 


I 


4 


14 


7mm 


2/04/98 


50 


New Hampshire 


ves 


D 


0 


_ 


7mm 


2/04/98 


50 


New Jersey 


no 


- 


- 


- 


4/03/97 


- 


_ 


New Mexico 


no 


I, D 


3 


21 


7mm 


2/04/98 


50 


New York 


no 


D 


27 


34 


4/03/97 


3/10/98 


49 


North Carolina 


yes 


I,D 


10 


- 


7mm 


2/04/98 


50 


North Dakota 


ves 


D 


1 


20 


imm 


2/04/98 


50 


Ohio 


yes 


I 


15 


- 


3/12/97 


2/04/98 


48 


Oklahoma 


no 


D, S 


29 


- 


4/03/97 


2/19/98 


46 


Oregon 


yes 


I, D 


8 


- 


7mm 


3/19/98 


56 


Pennsylvania 


yes 


D 


6 


15 


7mm 


2/04/98 


50 


Rhode Island 


no 


D 


11 


17 


imm 


2/19/98 


52 


South Carolina 


yes 


I 


0 


11 


7mm 


2/13/98 


51 


South Dakota 


yes 


I 


1 


9 


imm 


2/04/98 


50 


Tennessee 


no 


I 


27 


- 


7mm 


3/10/98 


55 


Texas 


yes 


D, S 


7 


- 


imm 


2/04/98 


50 


Utah 


no 


L S 


2 


19 


7mm 


2/04/98 


50 


Vermont 


no 


I, D 


33 


- 


7mm 


2/04/98 


50 


Virginia 


no 


I,S 


12 


- 


imm 


2/04/98 


50 


Washington 


no 


I, D 


7 


- 


4/03/97 


3/19/98 


50 


West Virginia 


yes 


I 


10 


19 


7mm 


2/04/98 


50 


Wisconsin 


yes 


I 


20 


- 


7mm 


2/04/98 


50 


Wyoming 


no 


I.S 


3 


_ 


imm 


2/04/98 


50 


Dept, of Defense 


no 


I 


32 


- 


imm 


2/04/98 


50 


American Samoa 


no 


s 


1 


- 


imm 


2/04/98 


50 


Guam 


no 


I 


0 


- 


imm 


2/04/98 


50 


North. Marianas 


yes 


D, S 


28 


- 


imm 


2/04/98 


50 


Puerto Rico 


no 


D 


15 


29 


4/03/97 


2/10/98 


45 


Virgin Islands 


ves 


D 


1 


8 


imm 


2/04/98 


50 


Notes: *1 = internet, D = diskette, S = shuttle 

* Indicates the time (in weeks) beyond the “due date" of 15 March 1997 that receipt of both the agency and school universe data files by 
NCES/agent occurred. This is necessary for processing to commence. 

♦♦Includes the time elapsed from mailout to receipt of the initial data files, the data summary and the edit reports. That is, the total 
respondent response time as depicted in Tables 2-1 and 2-3. 
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Table 2-5. Data Summary and Edit Phase Processing Time Interval for 1996-97 Nonfiscal CCD Surveys 


This table shows the interval between receipt of initial data file from state CCD coordinators andmailout for the data summary and edit 
phases of the CCD processing cycle. That is, it shows the internal processing time taken by NCES and/or its agent. 


State 


Latest File (Agn 
or Sch) 
Received 


Data Summary 
Mailed 


Processing 
Interval 
(in weeks) 


State Nonfiscal 
Received 


Edit 

Mailed 


Processing 
Interval* 
(in weeks) 


All states, avg. 


. 


- 


9 


_ 


_ 


23 


Alabama 


10/08/97 


10/17/97 


1 


10/08/97 


10/24/97 


2 


Alaska 


7/17/97 


11/18/97 


19 


7/17/97 


12/17/97 


23 


Arizona 


7/30/97 


8/06/97 


2 


7/30/97 


4/02/98 


35 


Arkansas 


9/30/97 


10/22/97 


• 4 


9/30/97 


1/27/98 


18 


California 


6/20/97 


7/08/97 


3 


7/23/97 


3/24/98 


31 


Colorado 


6/23/97 


2/24/98 


36 


6/24/97 


4/02/98 


40 


Connecticut 


9/30/97 


11/04/97 


6 


10/24/97 


12/17/97 


8 


Delaware 


4/09/97 


7/08/97 


14 


4/07/97 


1 1/25/97 


33 


Dis. of Columbia 


7/30/97 


1 1/20/97 


17 


7/30/97 


12/17/97 


21 


Florida 


4/07/97 


5/20/97 


6 


4/07/97 


1/08/98 


39 


Georgia 


5/30/97 


7/03/97 


5 


5/30/97 


9/22/97 


17 


Hawaii 


10/23/97 


11/19/97 


4 


9/18/97 


12/17/97 


13 


Idaho 


3/10/97 


5/20/97 


11 


8/04/97 


9/22/97 


7 


Dlinois 


10/02/97 


11/13/97 


6 


11/19/97 


1 1/25/97 


1 


Indiana 


6/25/97 


9/23/97 


13 


10/30/97 


11/25/97 


4 


Iowa 


3/31/97 


5/20/97 


7 


3/31/97 


9/22/97 


25 


Kansas 


10/24/97 


11/05/97 


2 


10/23/97 


12/17/97 


8 


Kentucky 


10/20/97 


1 1/20/97 


5 


8/27/97 


2/18/98 


25 


Louisiana 


8/14/97 


1 1/05/97 


12 


10/30/97 


2/19/98 


16 


Maine 


3/25/97 


5/20/97 


8 


3/25/97 


9/22/97 


26 


Maryland 


4/23/97 


5/20/97 


4 


4/23/97 


11/25/97 


31 


Massachusetts 


7/31/97 


12/15/97 


19 


10/29/97 


12/17/97 


7 


Michigan 


1 1/01/97 


1/21/98 


12 


11/13/97 


3/12/98 


17 


Minnesota 


10/31/97 


1/12/98 


10 


7/30/97 


4/02/98 


35 


Mississippi 


4/28/97 


5/20/97 


4 


4/28/97 


9/22/97 


22 


Missouri 


4/08/97 


7/08/97 


13 


4/16/97 


12/17/97 


35 


Montana 


4/18/97 


5/20/97 


4 


8/04/97 


9/22/97 


7 


Nebraska 


3/24/97 


5/20/97 


8 


3/24/97 


9/22/97 


26 


Nevada 


4/15/97 


7/08/97 


12 


4/15/97 


1 1/25/97 


32 


New Hampshire 


3/18/97 


5/20/97 


10 


3/18/97 


11/25/97 


27 


New Jersey** 


- 


- 


- 


- 


- 


- 


New Mexico 


4/07/97 


5/20/97 


7 


4/23/97 


9/22/97 


22 


New York 


9/23/97 


11/18/97 


9 


9/23/97 


1/28/98 


19 


North Carolina 


5/19/97 


7/03/97 


7 


5/20/97 


9/22/97 


19 


North Dakota 


3/25/97 


5/20/97 


9 


3/25/97 


9/22/97 


26 


Ohio 


6/24/97 


7/08/97 


2 


8/12/97 


12/17/97 


18 


Oklahoma 


10/01/97 


11/18/97 


7 


10/28/97 


1/29/98 


13 


Oregon 


5/12/97 


7/09/97 


9 


3/06/97 


3/23/98 


54 


Pennsylvania 


4/23/97 


5/20/97 


4 


4/23/97 


9/22/97 


23 


Rhode Island 


6/03/97 


10/16/97 


20 


6/03/97 


10/23/97 


21 


South Carolina 


3/14/97 


5/20/97 


9 


3/14/97 


9/22/97 


27 


South Dakota 


3/19/97 


5/20/97 


10 


3/19/97 


9/22/97 


28 


Tennessee 


9/19/97 


10/30/97 


6 


9/24/97 


2/19/98 


21 


Texas 


4/30/97 


6/16/97 


6 


4/30/97 


12/17/97 


32 


Utah 


3/26/97 


5/20/97 


8 


4/09/97 


9/22/97 


24 


Vermont 


10/31/97 


11/05/97 '1 


1 


9/04/97 


12/23/97 


16 


Virginia 


6/05/97 


6/16/97 


2 


10/27/97 


12/17/97 


7 


Washington 


5/05/97 


11/19/97 


29 


5/19/97 


3/23/98 


44 


West Virginia 


5/21/97 


6/16/97 


4 


5/21/97 


9/22/97 


17 


Wisconsin 


8/04/97 


10/16/97 


11 


8/04/97 


10/28/97 


13 


Wyoming 


4/01/97 


5/20/97 


7 


6/10/97 


1 1/07/97 


21 


Dept, of Defense* 


10/24/97 


12/17/97 


8 


- 


12/17/97 


- 


American Samoa 


3/21/97 


7/08/97 


16 


3/21/97 


12/17/97 


39 


Guam 


3/18/97 


5/20/97 


9 


3/18/97 


11/24/97 


36 


North. Marianas 


9/24/97 


10/29/97 


5 


3/18/97 


12/17/97 


39 


Puerto Rico 


6/23/97 


7/30/97 


6 


6/23/97 


10/15/97 


16 


Virgin Islands 


3/24/97 


5/20/97 


8 


3/24/97 


10/15/97 


29 


Notes: * The mailing of the edit report is not contingent upon receipt of data summary report, however, the state nonfiscal data file must be 

received in order to generate the cross-file consistency report which is mailed with the edit report. Thus, this processing interval 
begins with receipt of the state nonfiscal data file. The two intervals depicted here are not cumulative. 

** New Jersey did not submit any data files for 1996-97. 

* DoD did not submit a state nonfiscal data file. 
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CHAPTER 3. AGENCY UNIVERSE AND 
SCHOOL UNIVERSE CCD 
SURVEYS PROCESSING AND 
EDITING STAGES 



with pre-inserted data items 3 for the current year as well 
as prior year survey data to allow for comparison with 
current year data. The data summary apparently was 
used to detect two types of errors: 



Section 3.0 Introduction 

The processing and editing cycle for the evaluated 
surveys - the 1996-97 CCD Agency and School 
Universe Surveys - was characterized by five stages or 
phases. These stages, which to a large extent 
correspond to the SAS-based software programs and 
generated reports used to review and edit CCD survey 
data, included: data summary, ID assignment, internal 
report, main edit, and post-edit. These five stages were 
not necessarily mutually exclusive or sequential. 
Although for the purposes of this evaluation each of the 
stages is described individually, there was a certain 
degree of overlap in content as well as in the 
chronology of the processing and editing which took 
place in these stages. 

The following five sections of this chapter provide a 
detailed evaluation of the scope, intent, associated 
reports, and general effectiveness of each of these five 
stages. Next, the data correction and response rates 
associated with these stages in the survey cycle are 
reviewed, followed by a final section of 
recommendations related directly to these stages. 

Section 3.1 Data Summary 

Upon receipt of both the agency data file and the school 
data file, the first phase of the 1996-97 nonfiscal CCD 
surveys data processing and editing cycle by 
NCES/agent began. In this stage, the “data summary” 
stage, all states’ initial data submissions were converted 
into a form that could be processed by the SAS-based 
processing and editing software programs. Essentially, 
the data summary programs generated two reports - the 
“data summary report” and the “match report” - that 
were sent to each state CCD coordinator for his/her 
review and response. 



• initial data submissions which had improperly 
formatted data or other significant formatting 
errors, and 

• data submissions which had significant 
discrepancies (at a summary level) when 
current and prior year data values are 
compared. 

The match report, similar to the data summary report, 
was intended to serve as an edit-function for both the 
agency and the school data files. The match report 
identified missing data, potential errors, or any apparent 
discrepancy in the submitted data files. 

This report consisted of two parts - one part each for the 
agency and school files. The first part indicated that 
verification of certain data was requested (for example, 
verifying that an agency operational the previous year 
and reported as closed for the current year was indeed 
closed). Second, and perhaps more importantly, the 
match report identified situations where resolution of a 
data inconsistency or “error” was required by the state. 
For example, a school which was listed as operational 
for the previous year yet was not reported for the 
current year, or a reported school was not associated 
(by identification number) with any education agency 
on the agency data file. These data errors or failures 
which required resolution were essentially 
“impossibilities” that needed to be corrected or resolved 
as quickly as possible. 

The match report was critical to establishing the survey 
universe. If the issues identified on the match report 
went unresolved they would (and did) contribute to the 
delay of the entire current survey cycle in addition to 
preventing the commencement of the next survey cycle. 

As indicated earlier, the states were asked to respond 
within two weeks with their comments and corrections 



The data summary report was designed to allow 
respondents the opportunity to view (and review) the 
agency and school data initially submitted by their state 
CCD coordinators from a slightly different perspective. 
That is, each record’s (agency or school) identifying 
information and basic statistics were displayed at the 
aggregate-level for each particular state. This report 
provided information regarding any changes associated 



3 Pre-inserted items , for the school file , include: 
NCES education agency ID number , state education ID 
number , education agency name ; state school ID number ; 
address , city, state, zip code, phone number, school type 
code, operational status code, and locale code; and, for the 
agency file: state education agency ID number, agency 
name, address, city, state, zip code, phone number, 
education agency type code, supervisory union code, FIPS 
county code, CMSA/PMSA/MSA code, metropolitan status 
code, and boundary code. 
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to the data summary and match reports that were mailed 
to them by NCES or its agent. Data summary 
“corrections” were basically adjustments to aggregate- 
level, basic statistics based on respondent review and 
comparison of current year to prior year data. There 
was no actual identification or indication of data 
“errors” that needed to be addressed by the respondent. 
In fact, the states were apparently not given many 
detailed, or specific, instructions as to what they were 
supposed to be scrutinizing on the data summary report, 
although a general cover letter requesting the states to 
review and respond did accompany the reports. 

The match report data corrections depicted in Table 3-1 
indicate the number of error messages or data failures 
generated by the data summary program that were 
considered critical and required resolution. Thus, 
corrections to these errors or inconsistencies were either 
made by the respondent or NCES collection agent 
regardless if a formal data summary response was 
submitted. Table 3-1 shows the number of all 
corrections to the generated reports made, by either the 
states or NCES/agent, at various stages in the 
processing and editing cycle. 



inconsistencies identified at this point included 
situations where, for example, the NCES identification 
number and agency boundary code did not correspond, 
or, where a school’s operational status did not 
correspond with its state identification number. 

The generated report was not sent to the states for 
review. Often the questions identified at this stage were 
resolved by NCES/agent staff through review of 
previous year data files, or via telephone, e-mail, or fax 
communication with respondent who provided the 
necessary clarifications and corrections. 

Due to the fact, however, that the NCES/agent staff 
were required to either wait for a formal data summary 
response from the state or contact the state CCD 
coordinator directly in seeking resolution to identified 
data discrepancies, there were often delays in the 
processing and editing cycle during this stage. Again, 
the issues and problems detected at this point in the 
cycle required resolution in order to establish the survey 
universe and to proceed with the CCD processing and 
editing. 



Section 3.2 ID Assignment 

The primary intent of this stage was to establish the 
survey universe for the current year survey by creating 
and assigning new NCES agency and school 
identification numbers for all newly reported schools 
and agencies. As with the data summary phase, both the 
agency and school data files must have been received in 
order to process the data and to generate these new 
identification numbers. 

If the match report in the data summary stage did not 
indicate any problems (i.e., if there were not any data 
errors or failures which required resolution) with the 
submitted data, then the states’ data files could be 
processed through the identification (ID) assignment 
program right away. Otherwise, further investigation 
was necessary to evaluate data inconsistencies and 
problems. In some cases, the data summary (including 
the match report) response from the state resolved the 
problems and allowed the ID assignment to be 
completed. 

The SAS-based software program associated with this 
stage, in addition to assigning new identification 
numbers, also processed the agency and school files for 
duplicate records (duplicate identification numbers), 
matched schools to an education agency by state 
identification number, and checked for inconsistencies 
between data elements. The type of data problems or 



Section 33 Internal Report 

The main objective of this stage of the processing and 
editing cycle for the CCD agency and school surveys 
was to check the submitted state data files for invalid 
data in preparing them for the main edit programs. That 
is, essentially to “clean up” the data files by examining 
the data in critical fields for inaccuracies and omissions. 
The report generated here was for internal purposes 
only and was not sent to the states for review. 



The internal report program processed the data files by 
examining the data elements associated with 
identifying administrative information, such as name, 
address, identification number, etc. This program also 
examined the basic statistical responses, such as student 
and staff counts, for data fields that contained “M’s,” 
“N’s,” “0's,” and blanks. While some of these responses 
were appropriate, this validation check was designed to 
identify any invalid response. Responses with these 
values in data fields, as defined in survey reporting 
materials, were intended to indicate the following: 

M - when the data were missing and where a 
value is expected, but no value was measured 

N - when the data were not applicable and where 
a value was neither expected nor measured 
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0 (zero) - when a numerical value was measured 
and no quantity was found 
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Blank - when data field contained no response 

The internal report program also performed validity 
checks on the data fields in the submitted agency and 
school data files for other invalid nonnumeric values or 
out-of-range responses. For example, several of the data 
elements (variables) such as school file agency name 
(LEANM), school name (SCHNAM), agency file 
agency name (NAME), street name (STREET), city 
name (CITY) generated an error message if its length 
was less than or equal to three characters. Three other 
variables, ZIP, ZIP4, and PHONE, similarly generated 
error messages if the responses were less than a certain 
number of characters. 

A review of the internal report for all 56 (New Jersey 
did not submit data files) states revealed some 
noteworthy findings. For the agency data files, 19 states 
generated no error messages associated with this report. 
For the school data files, in only five states was this the 
case. The error message associated with the locale code 
variable, indicating either a blank or inappropriate 
response, in the school data files was the most prevalent 
of all the edit messages generated. This message 
appeared 4,048 times in all for the 49 states’ data which 
generated it. 

The edit messages associated with a variable name 
having three or fewer characters, such as school or 
agency name, city name, or street name, was reported 
some 304 times for the agency and school data 4 . 
Interestingly, manual review of these reports indicated 
that all of these three-letter variable names were valid, 
or at least, they were not apparently changed or 
corrected. 

As in the ID assignment stage, any error message or 
problem identified at this point that required resolution 
was either resolved by NCES/agent through a review 
of previous year data or referred directly to the 
respondents for their input. Many of the edits 
associated with the identifying and administrative 
information in this stage, while important for record 
completeness and accuracy, essentially performed 
validity checks on data which could have been checked 
earlier in the process. In general, however, the 
evaluation found this phase of the process and editing 
cycle to be thorough and useful, particularly in 
preparing the state data files for the more stringent edit 
checks in the next stage. 



4 

Of the 304 total displayed error messages, 238 
were associated with dry name, 36 with street name, and 
30 with agency or school name. 



Section 3.4 Main Edit 

This is the stage of the processing and editing cycle in 
which a comprehensive review and edit took place on 
initially submitted data files. These files, to varying 
degrees, had been reviewed, corrected, and edited via 
the three previously described stages in the nonfiscal 
CCD survey processing and editing cycle. The main 
S AS-based software edit program, hereafter referred to 
as the “main edit program”, applied a series of stringent 
edit checks to both the agency and school data files. 
These edits are discussed in detail in the next chapter. 

The main edit program generated three type of reports. 
The first, “Summary of Missing/Erroneous Data”, 
displayed, separately for the agency and school 
universes, the total number of submitted records, the 
number of such records in error, the total number of 
errors, as well as the total number of errors associated 
with an individual edit as generated by the submitted 
data files. Although this report was not sent to the states 
for their review, scrutiny of these edits constituted a 
large portion of this evaluation and will be covered in 
detail in the next chapter. 

The “Cross-file Consistency Report”, the second 
generated report, provided a comparison of various 
corresponding data category totals between the reported 
state nonfiscal data and both the agency and school 
totals. This report, and the 1996-97 State Nonfiscal 
CCD Survey, are addressed in Chapter 6. 

The third report, the “Edit Report”, provided a listing of 
edit messages associated with identified errors for the 
top 50 most error-filled agency records, and the 100 
most error-filled school records for each state. Errors 
listed in the edit report were identified with an edit 
status of “C”, indicating a critical error, or “W” for a 
warning error. The weighting system, which determined 
the highest weighted in-error records, was predicated on 
the assignment to a critical error a value of “10", and a 
warning message a value of “1 ". 

These edit reports, along with the cross-file consistency 
report, were sent to the states for their review. 
Respondents were asked to make manual corrections 
and to provide their comments within two weeks. Table 
3-1 displays the number of respondent-made 
corrections as a result of this review. The non-response 
issue will be discussed later in this chapter. 
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Section 3.5 Post-Edit 

The stated purpose of this final phase of the processing 
and editing cycle was, as an edit-function, to determine 
if any additional “critical” data changes or corrections 
were necessary. This phase was also used to ensure that 
all response fields in the survey contained a response 
before the files were merged for delivery to NCES as 
complete, final data files (these data files were also 
included in the following survey year’s initial mailout 
as “prior year” data). The post-edit program essentially 
performed the following edit functions: 

• Converted remaining blanks in pre-inserted 
items to prior year data (if there was a match 
between current and prior year) or to “M”. 

• Converted all closed school data to “N”. 

• Converted remaining “blanks” (no response 
provided) to “M”. 

• Where there were data in some categories 
(like student total membership by grade 
provided for some but not all grades), 
converted “N” to zero (0). 

• Where there were no data in any category, 
converted all “M’s” or zeroes (0’s) to “N”. 

The post-edit program also generated several reports, 
including some 28 summary reports, which provided 
details concerning the changes and conversions (e.g., 
the number of records where classroom teachers was 
blank and converted to “M”) made to each state’s data 
files at this point. Some reports provided information, 
or identification, of remaining data inconsistencies, 
such as schools records not associated with any agency, 
a blank or missing metropolitan status code, or a current 
year FIPS code that did not match the previous year, 
that required additional research and resolution (a 
manual review of these post-edit summary reports was 
on-going at the time of this evaluation). 

All of these reports were intended for internal review 
and were not sent to the states for comment or review. 
In a few instances, these reports appeared to identify 
issues which should have been resolved earlier in the 
processing and editing cycle. In any event, for the 
observed processing and editing cycle, apparently due 
to time and resource constraints, very little use was 
made of these reports at this time. Later, the post-edited 
data were presented in several tables to NCES for their 
review and verification. 



A second data summary report was generated, in part, 
to prepare the data file to be processed through the 
post-edit program. A final cross-file consistency report 
and internal report, as well as a third data summary 
report (the same format and presentation as the previous 
two) were also generated by the post-edit program. This 
evaluation observed these reports not to be used for any 
tangible evaluative purpose for this survey cycle. 

The apparent purpose (and use) of the post-edit for the 
observed cycle was to prepare the states’ data files for 
the subsequent year mailout, in this case for the 1997- 
98 Nonfiscal CCD Surveys. Earlier delays and the 
general “lateness” of the current survey, particularly as 
it affected the subsequent survey year’s mailout, caused 
the processing for most states at this point to be rather 
cursory. The primary focus at this stage in the survey 
cycle apparently was not one of edit, but simply to 
complete as final all remaining states’ data files. 

This evaluation did not address any edits in use beyond 
the post-edit phase. Thus, any editing done by NCES 
to assist in the review of tabulated data, such as 
aggregates for publication in printed reports, was 
beyond the scope of this evaluation. Apparently, 
however, these processes do add considerable time to 
the overall cycle. 



Section 3.6 1996-97 CCD Data Correction and 
Response Rates 

One of the more remarkable aspects of this survey 
cycle was the very high non-response rates exhibited by 
the participants. This was particulary in evidence for the 
data summary phase and, even more so, for the edit 
phase. In both instances, the states were requested to 
respond by reviewing and correcting reports which had 
been mailed to them for their comments. 
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Type of 
submission 


Non-respondents 


No. 


% 


Initial data files 


1 


1.8 


Data summary report 
response 


17 


29.8 


Edit report response 


37 


64.9 



For the 1996-97 Nonfiscal CCD Surveys cycle while 
only one state. New Jersey, did not submit initial data 
files, almost one-third did not respond to the data 
summary response request. About two-thirds of the 
states failed to provide an edit response as shown in the 
above chart. These response rates were based on 
verifiable documented (marked-up originals or fax 
transmissions in most cases) responses returned by the 
respondents. It was likely that some data issues or 
questions were handled by informal (undocumented) 
communication between the respondent and NCES or 
its collection agent. The implications of such low 
participation rates in these critical editing procedures 
clearly speak to the issues of survey completeness and 
accuracy. 

Given the low response rates, the very small number of 
changes or corrections attributed to respondent review 
was not found to be all that surprising. Indeed, the 33 
total corrections made at data summary phase and the 
219 corrections at the edit phase, as presented in Table 
3-1 for both the agency and school files, represented a 
very minute number and percentage, especially when 
considering the volume of errors that were generated 
and potentially reviewed. This was especially true for 
the edit report corrections 5 . 

Tables 3-2 and 3-3 present the number of total records, 
the number of in-error records and the percentage of 
these records ultimately reviewed and corrected at the 
edit stage for both the agency and school surveys. Some 
rather notable figures stand out. 

For the agency universe, of the submitted 15,848 
records from the 56 states that provided initial data 
files, 9,891, or just over 60 percent, contained at least 
one error as generated by the CCD main edit program. 
The 20 states which responded to the edit reports 
actually reviewed slightly less than 40 percent of the 
error-filled records, while correcting only about two- 



5 The cross-file consistency related correction 
rates will be discussed in Chapter 6. 
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tenths of one percent (54 corrections divided by the 
20,591 total errors for responding states) of the total 
errors. These percentages dropped to 20 percent and a 
very minuscule 0.3 percent when all states (including 
the non-respondent states) were taken into account. 

For the school universe, of the 88,987 records 
submitted, 27,387 of them contained errors for an in- 
error rate of about 30 percent. Similar to the agency file 
figures, about 46 percent of error-filled records were 
reviewed and 3 percent of total errors corrected for the 
20 responding states, and 18 percent and 0.3 percent for 
all states, for the school survey data in Table 3-3. 

Important to remember, the states were not mailed all of 
their records that contained errors - only the top 50 
error-filled agency records (top 100 for school record 
files) were returned for comment. Due to this fact, less 
than one-half of the states were provided the 
opportunity to review aH of their agency records which 
generated errors during the edit stage processing. Only 
about 20 percent of the respondents had the opportunity 
to review all of their error-filled school records. Several 
of the larger states, including California, Illinois, 
Michigan, and Texas among others, had the opportunity 
to review less than 10 percent of their agency and/or 
school in-error records. Table 3-3 provides a state-by- 
state summary of these percentages. 

NCES/agent survey data processing staff indicated that 
the low return and correction rates, particularly for the 
data summary and edit report requests, stemmed from 
unique situations in various states which resulted in the 
same errors being generated year after year. In short, it 
was suggested that this occurrence indicated the 
respondents were, generally speaking, at odds with 
having to deal with the same non-issues every year 6 . 
Regardless, the fact that less than 20 percent of all in- 
error data records were ever reviewed by the 
respondents and that about one-half of all the materials 
mailed to the states after their initial data submissions 
were not returned indicated serious potential 
shortcomings in data quality and overall accuracy of the 
surveys. 



6 4 technical review panel conducted in 
November 1997 by NCES on the topic of editing and 
processing with several state CCD coordinators generally 
supported this notion as well as several of the 
recommendations made in this chapter. 
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Section 3.7 Recommendations 

Review of the five primary stages which made up the 
nonfiscal CCD survey cycle resulted in several 
recommendations. It is suggested that any changes or 
revisions to the processing and editing activities which 
occur as a result of the anticipated CCD survey 
expansion for 1998-99 should include consideration of 
the following: 

1 . Given the very low survey follow up response and 
error-correction rates along with the condition 
that many error corrections were apparently 
initiated and addressed by NCES/agent, the 
efficacy of the existing post-submission edit and 
review process is brought into question. A radical 
approach would involve revamping the edit 
process to eliminate (or significantly reduce), as 
much as possible, the procedure of returning edit 
materials/reports back to the states for their 
review. Such action would more formally place 
the burden and responsibility of data editing on 
NCES and its agent. This is to a large extent, 
however, what occurs anyway. 

2. Other, less radical, recommendations would 
include adjustments to the current procedures. 
Several of these recommendations relate directly 
to the physical layout/presentation of the current 
data summary report. Alternative format 
suggestions include: 

a. Provide more detailed descriptions of what is 
expected of the respondent in terms of 
reviewing and correcting the data presented 
in this report, including highlighting the due 
date, directly on the report. 

b. Delete the “five smallest and largest values” 
headings and data for all data categories from 
the report. 

c. Place current year data and prior year data 
side-by-side and arrange dropout data totals 
in a tabular form (less the five 
smallest/largest data categories) to enhance 
ease of data comparison. 

d. For the school universe report, add a heading 

“OPERATIONAL STATUS” - above the 
listing of schools (new, closed, etc.). 

e. For the agency universe report, add a heading 
- “BOUNDARY STATUS” - above the 
listed LEA data categories. 



3. More clearly highlight the allotted two week 
response time interval requested for state 
response, perhaps specifying an actual due date, 
in the instructions at the top of the match report. 

4. Add an edit into the Edit System software 
program to compare assigned state and NCES 
identification numbers. This would require that 
the database listing of previously assigned 
identification (ID) numbers be provided with the 
initial reporting materials, but would eliminate the 
identification conflict “impossibilities” (such as a 
state education agency ID number being 
associated with more than one NCES education 
agency ID number on the school file) that 
appeared on the match report, often requiring 
resolution by the respondent and resulting in time 
delays. 

5. Provide respondents with capability, when 
necessary, to assign their own new ID numbers. 
This could, among other possibilities, be 
accomplished by: 

a. Modifying Edit System software to generate 
new NCES agency and school ID numbers 
from the ALLLEAID and ALLSCHNO data 
files (the files from which new ID numbers 
are assigned) as states add new agencies or 
schools to their survey universes. 

b. Providing states access to the ALLLEAID 
and ALLSCHNO data files directly via the 
internet. 

6. Perform the internal report “edit” earlier in the 
editing and processing cycle. This would provide 
a barometer of the quality of a state’s submission. 
Any potential data issues might be addressed 
sooner, perhaps included as part of the data 
summary program and report mailout, thereby 
eliminating the current practice of having to 
repeatedly contact respondents directly. 

7. Modify the validity edits in the internal report 
program (similar to all subsequent edit programs) 
that examine identifying information data, like 
agency or school name, city name, or street name. 
It is recommended that the defining criteria be 
changed to identify responses having two 
characters or less rather than three characters or 
less. Although these certainly are not critical 
edits, this change would eliminate many of the 
error messages that state and federal reviewers 
and analysts must filter. 

36 
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8. Replace the existing edit reports (which consist of 
the top 50 agency and top 100 school error- filled 
records) with an edit “summary report.” It is 
recommended that such a report indicate the 
record (agency or school) ID number, the data 
response in question, the error type (critical or 
warning), and the error message generated for all 
in-error records. This action would accomplish 
two important feats: 

a. Reduce the volume (and length) of edit 
materials requiring review that would be sent 
back out to the states, thus reducing 
respondent burden and likely improving 
response rates. 

b. Ensure that all in-error records (and 
individual errors) would be available for 
respondent review. 

9. In order to make more productive use of the post- 
edit stage, consideration should be given to 
thoroughly reexamining the 28 generated post- 
edit summary reports for their intended purpose, 
function, and usefulness, as a component of the 
processing and editing cycle. 
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Table 3-1. Summary of Number of Corrections Made at Data Summary and Edit Phases to Submitted Data Files in 1996-97 Nonfiscal 

CCD Surveys 



This table shows the occurrence and number of data corrections made by respondent and NCES collection agent ; based on 
state data submissions, at various stages in the 1996-97 Nonfiscal CCD Surveys data processing and editing cycle. 





Pre-Edit Reports 


Edit Reports 


State 


Data Summary 


Match Report* 


Internal Report 


Cross-File 


Edit Report 




Agency 


School 


Agency 


School 


Agency 


School 


St- Agn 


SL-Sch 


Agency 


School 


Total 


12 


21 


372 


1.869 


35 


97 


8 


5 


54 


! 165 


Alabama 


1 


1 


0 


0 


0 


0 


1 


0 


0 


0 


Alaska 


2 


0 


0 


7 


1 


0 


na 


na 


na 


na 


Arizona 


na 


na 


79 


26 


0 


0 


na 


na 


na 


na 


Arkansas 


1 


0 


17 


3 


0 


0 


0 


0 


16 


103 


California 


0 


0 


3 


26 


0 


0 


na 


na 


na 


na 


Colorado 


0 


0 


3 


126 


1 


2 


na 


na 


na 


na 


Connecticut 


0 


0 


1 


5 


0 


57 


na 


na 


na 


na 


Delaware 


0 


7 


0 


1 


1 


1 


1 


0 


1 


3 


Dis. of Columbia 


na 


na 


0 


2 


0 


0 


na 


na 


na 


na 


Florida 


0 


0 


0 


100 


0 


0 


na 


na 


na 


na 


Georgia 


0 


0 


3 


29 


0 


0 


na 


na 


na 


na 


Hawaii 


na 


na 


0 


0 


0 


0 


na 


na 


na 


na 


Idaho 


0 


0 


0 


10 


0 


0 


na 


na 


na 


na 


Illinois 


na 


na 


0 


3 


0 


0 


na 


na 


na 


na 


Indiana 


na 


na 


0 


13 


0 


0 


na 


na 


na 


na 


Iowa 


0 


0 


0 


11 


0 


1 


na 


na 


na 


na 


Kansas 


0 


0 


0 


46 


0 


0 


0 


0 


0 


0 


Kentucky 


na 


na 


79 


0 


0 


0 


na 


na 


na 


na 


Louisiana 


na 


na 


0 


25 


0 


0 


na 


na 


na 


na 


Maine 


0 


0 


0 


0 


0 


0 


0 


4 


0 


1 


Maryland 


0 


0 


0 


12 


0 


1 


0 


1 


0 


0 


Massachusetts 


na 


na 


1 


0 


0 


0 


na 


na 


na 


na 


Michigan 


0 


0 


37 


587 


0 


0 


na 


na 


na 


na 


Minnesota 


na 


na 


61 


277 


12 


0 


na 


na 


na 


na 


Mississippi 


0 


0 


0 


3 


0 


0 


0 


0 


3 


5 


Missouri • 


na 


na 


5 


0 


0 


0 


na 


na 


na 


na 


Montana 


0 


0 


0 


0 


0 


0 


na 


na 


na 


na 


Nebraska 


0 


0 


1 


3 


0 


0 


1 


0 


12 


0 


Nevada 


0 


0 


0 


2 


0 


7 


1 


0 


0 


2 


New Hampshire 


0 


0 


3 


4 


3 


1 


na 


na 


na 


na 


New Jersey** 


- 


- 


- 


- 


- 


- 


- 


- 


- 


_ 


New Mexico 


0 


0 


0 


1 


0 


1 


3 


0 


9 


2 


New York 


1 


1 


3 


10 


0 


1 


1 


0 


2 


0 


North Carolina 


0 


0 


0 


11 


0 


0 


na 


na 


na 


na 


North Dakota 


0 


0 


0 


3 


0 


0 


0 


0 


0 


0 


Ohio 


na 


na 


5 


20 


0 


0 


na 


na 


na 


na 


Oklahoma 


0 


0 


3 


5 


0 


0 


na 


na 


na 


na 


Oregon 


na 


na 


32 


113 


0 


0 


na 


na 


na 


na 


Pennsylvania 


2 


0 


1 


6 


1 


0 


0 


0 


0 


0 


Rhode Island 


0 


1 


0 


0 


0 


0 


0 


0 


0 


I 


South Carolina 


0 


0 


0 


27 


0 


0 


0 


0 


9 


3 


South Dakota 


0 


0 


1 


4 


0 


0 


0 


0 


0 


0 


Tennessee 


0 


5 


0 


160 


0 


0 


na 


na 


na 


na 


Texas 


0 


0 


17 


32 


0 


0 


na 


na 


na 


na 


Utah 


0 


0 


0 


0 


0 


1 


0 


0 


0 


4 


Vermont 


0 


0 


12 


9 


5 


0 


na 


na 


na 


na 


Virginia 


2 


0 


5 


0 


4 


0 


na 


na 


na 


na 


Washington 


na 


na 


0 


92 


7 


0 


na 


na 


na 


na 


West Virginia 


0 


0 


0 


0 


0 


6 


0 


0 


0 


0 


Wisconsin 


na 


na 


0 


0 


0 


0 


na 


na 


na 


na 


Wyoming 


0 


0 


0 


1 


0 


0 


na 


na 


na 


na 


Dept, of Defense 


na 


na 


0 


11 


0 


0 


na 


na 


na 


na 


American Samoa 


na 


na 


0 


0 


0 


0 


na 


na 


na 


na 


Guam 


3 


6 


0 


0 


0 


0 


na 


na 


na 


na 


North. Marianas 


0 


0 


0 


0 


0 


0 


na 


na 


na 


na 


Puerto Rico 


0 


0 


0 


43 


0 


18 


0 


0 


2 


38 


Virgin Islands 


0 


0 


0 


0 


0 


0 


0 


0 


0 


3 



Notes: *Indicates the number of error messages generated by data summary program that required resolution and, thus, were either corrected by 
the respondent or NCES collection agent regardless if a formal data summary response was submitted by respondent. 

**New Jersey did not submit any data files for 1996-97: na = not available, no response was received as of 30 April 1998. 
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Table 3-2. Summary of Total Number of Records in Error and Total Number of Errors Generated from Main Edit Program for 

Submitted Data Files in 1996-97 Nonfiscal CCD Surveys 


This table shows the number of agency and school data records in error at the edit stage in the 1996-97 Nonfiscal CCD 
Surveys data processing cycle . It also shows the number of error and warning messages these records generated as well as 

the percentage of records in error. 




Agency Universe 


School Universe 


State 


Number 

of 

Records 


Number 

of 

Records 
in Error 


Percent 

of 

Records 
in Error 


Total 
Number 
of Errors 


Number 

of 

Records 


Number 

of 

Records 
in Error 


Percent. 

of 

Records 
in Error 


Total 
Number 
of Errors 


Total/ Average* 


15.848 


9.891 


62.4 


20.591 


88.987 


27.387 


30.8 


52.228 


Alabama 


131 


21 


16.0 


51 


1,349 


179 


13.3 


300 


Alaska 


55 


24 


43.6 


37 


505 


173 


34.3 


267 


Arizona 


317 


190 


59.9 


561 


1,357 


335 


24.7 


553 


Arkansas 


332 


89 


26.8 


190 


1,107 


105 


9.5 


191 


California 


1,060 


795 


75.0 


1,235 


8.004 


1,620 


20.2 


2,260 


Colorado 


194 


50 


25.8 


63 


1,540 


323 


21.0 


521 


Connecticut 


179 


50 


27.9 


70 


1,065 


128 


12.0 


213 


Delaware 


24 


24 


100.0 


46 


184 


44 


23.9 


76 


Dis. of Columbia 


1 


1 


100.0 


2 


187 


101 


54.0 


149 


Florida 


74 


27 


36.5 


53 


2,880 


642 


22.3 


1.017 


Georgia 


183 


37 


20.2 


39 


1,831 


435 


23.8 


766 


Hawaii 


1 


1 


100.0 


1 


249 


42 


16.9 


103 


Idaho 


113 


19 


16.8 


30 


640 


629 


98.3 


734 


Illinois 


1,046 


864 


82.6 


1,904 


4,229 


596 


14.1 


922 


Indiana 


327 


64 


19.6 


118 


1.959 


224 


11.4 


380 


Iowa 


415 


199 


48.0 


318 


1,564 


225 


14.4 


321 


Kansas 


304 


97 


31.9 


107 


1,525 


180 


11.8 


290 


Kentucky 


258 


258 


100.0 


855 


1,454 


222 


15.3 


391 


Louisiana 


72 


32 


44.4 


69 


1,487 


178 


12.0 


272 


Maine 


326 


219 


67.2 


563 


729 


108 


14.8 


167 


Maryland 


24 


9 


37.5 


9 


1,289 


104 


8.1 


177 


Massachusetts 


465 


465 


100.0 


2,047 


1,880 


1,856 


98.7 


3,911 


Michigan 


730 


730 


100.0 


1,869 


4,006 


947 


23.6 


1,733 


Minnesota 


459 


395 


86.1 


703 


2,159 


1,062 


49.2 


1,869 


Mississippi 


164 


80 


48.8 


108 


1.027 


236 


23.0 


360 


Missouri 


532 


119 


22.4 


172 


2,315 


424 


18.3 


681 


Montana 


557 


280 


50.3 


650 


899 


233 


25.9 


282 


Nebraska 


786 


396 


50.4 


752 


1,423 


518 


36.4 


910 


Nevada 


18 


7 


38.9 


16 


444 


91 


20.5 


168 


New Hampshire 


248 


248 


100.0 


582 


517 


82 


15.9 


114 


New Jersey** 


- 


- 


- 


- 


- 


. 


- 


- 


New Mexico 


89 


24 


27.0 


28 


734 


69 


9.4 


100 


New York 


756 


317 


41.9 


402 


4,221 


548 


13.0 


955 


North Carolina 


123 


102 


82.9 


160 


2,018 


164 


8.1 


271 


North Dakota 


285 


73 


25.6 


119 


615 


148 


24.1 


239 


Ohio 


781 


767 


98.2 


1,616 


3,922 


620 


15.8 


1,024 


Oklahoma 


550 


549 


99.8 


757 


1,839 


' 272 


14.8 


375 


Oregon 


249 


62 


24.9 


96 


1,231 


177 


14.4 


240 


Pennsylvania 


615 


117 


19.0 


205 


3,213 


315 


9.8 


585 


Rhode Island 


37 


8 


21.6 


9 


316 


71 


22.5 


100 


South Carolina 


106 


28 


26.4 


45 


1,088 


170 


15.6 


272 


South Dakota 


219 


86 


39.3 


166 


851 


271 


31.8 


381 


Tennessee 


140 


140 


100.0 


465 


1,582 


1,565 


98.9 


3,470 


Texas 


1,060 


1,059 


99.9 


1,394 


6,979 


6,849 


98.1 


18,641 


Utah 


47 


39 


83.0 


61 


749 


77 


10.3 


133 


Vermont 


346 


138 


39.9 


407 


400 


151 


37.8 


227 


Virginia 


169 


169 


100.0 


597 


1,931 


1,895 


98.1 


2,185 


Washington 


305 


305 


100.0 


621 


2,180 


547 


25.1 


920 


West Virginia 


57 


18 


31.6 


28 


883 


133 


15.1 


203 


Wisconsin 


444 


65 


14.6 


88 


2,119 


237 


11.2 


385 


Wyoming 


58 


18 


31.0 


35 


413 


82 


19.9 


109 


Dept, of Defense 


12 


12 


100.0 


63 


173 


165 


95.4 


225 


American Samoa 


1 


1 


100.0 


1 


31 


31 


100.0 


34 


Guam 


1 


1 


100.0 


2 


35 


16 


45.7 


27 


North. Marianas 


1 


1 


100.0 


1 


26 


13 


50.0 


35 


Puerto Rico 


1 


1 


100.0 


2 


1,599 


754 


47.2 


983 


Virgin Islands 


1 


1 


100.0 


3 


35 


5 


14.3 


11 


Notes: *For number of records, number of records in error, and total number of errors these values are totals. The percentage of records in 
error is an average of all states and outlying areas. 

**New Jersey did not submit any data files for 1996-97. 0 ^ 
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Table 3-3. Summary of Percentage of Records in Error Reviewed and Errors Corrected by Respondents During Edit Phase in 1996- 

97 Nonfiscal CCD Surveys 


This table shows the percentage of agency and school data records in error and the percentage of records in errors reviewed 
and correctedby respondent during the edit stage in the 1996-97 Nonfiscal CCD Surveys data processing cycle . 






Agency Universe 






School Universe 




State 


No. of 
records 
in error 


%of in- 
error 
records 
reviewed** 


No. of 
errors 
corrected 


%of 

record 

errors 

corrected 


No. of 
records 
in error 


%of in- 
error 
records 
reviewed** 


No. of 
errors 
corrected 


%of 

record 

errors 

corrected 


Total/Avg. 

States responding 


1,647 


38.3 


54 


2.2 


3.578 


46.3 


165 


2.9 


All states 


9.891 


20.3 


54 


0.3 


27.387 


18.3 


165 


0.3 


Alabama 


21 


100.0 


0 


0.0 


179 


55.9 


0 


0.0 


Alaska 


24 


100.0 


na 


- 


173 


57.8 


na 




Arizona 


190 


26.3 


na 


- 


335 


29.9 


na 


_ 


Arkansas 


89 


56.2 


16 


8.4 


105 


95.2 


103 


53.9 


California 


795 


6.3 


na 


- 


1.620 


6.2 


na 




Colorado 


50 


100.0 


na 


- 


323 


31.0 


na 


_ 


Connecticut 


50 


100.0 


na 


- 


128 


78.1 


na 




Delaware 


24 


100.0 


1 


2.2 


44 


100.0 


3 


3.9 


Dis. of Columbia 


1 


100.0 


na 


- 


101 


99.0 


na 




Florida 


27 


100.0 


na 


- 


642 


15.6 


na 


„ 


Georgia 


37 


100.0 


na 


- 


435 


23.0 


na 


_ 


Hawaii 


1 


100.0 


na 


- 


42 


100.0 


na 


_ 


Idaho 


19 


100.0 


na 


- 


629 


15.9 


na 




Illinois 


864 


5.8 


na 


- 


596 


16.8 


na 


_ 


Indiana 


64 


78.1 


na 


- 


224 


44.6 


na 




Iowa 


199 


25.1 


na 


- 


225 


44.4 


na 


_ 


Kansas 


97 


51.5 


0 


0.0 


180 


55.6 


0 


0.0 


Kentucky 


258 


19.4 


na 


- 


222 


45.0 


na 


. 


Louisiana 


32 


100.0 


na 


- 


178 


56.2 


na 


. 


Maine 


219 


22.8 


0 


0.0 


108 


92.6 


1 


0.0 


Maryland 


9 


100.0 


0 


0.0 


104 


96.2 


0 


0.0 


Massachusetts 


465 


10.8 


na 


- 


1,856 


5.4 


na 


- 


Michigan 


730 


6.8 


na 


- 


947 


10.6 


na 




Minnesota 


395 


12.7 


na 


- 


1,062 


9.4 


na 




Mississippi 


80 


62.5 


3 


2.8 


236 


42.4 


5 


1.4 


Missouri 


119 


42.0 


na 


- 


424 


23.6 


na 


_ 


Montana 


280 


17.9 


na 


- 


233 


42.9 


na 




Nebraska 


396 


12.6 


12 


1.6 


518 


19.3 


0 


0.0 


Nevada 


7 


100.0 


0 


0.0 


91 


100.0 


2 


1.2 


New Hampshire 


248 


20.2 


na 




82 


100.0 


na 


_ 


New Jersey* 


- 


- 


- 


- 


- 


- 


- 


_ 


New Mexico 


24 


100.0 


9 


32.1 


69 


100.0 


2 


2.0 


New York 


317 


15.8 


2 


0.5 


548 


18.2 


na 


_ 


North Carolina 


102 


49.0 


na 


- 


164 


61.0 


na 


_ 


North Dakota 


73 


68.5 


0 


0.0 


148 


67.6 


0 


0.0 


Ohio 


767 


6.5 


na 


- 


620 


16.1 


na 


_ 


Oklahoma 


549 


9.1 


na 


- 


272 


36.8 


na 


_ 


Oregon 


62 


80.6 


na 


- 


177 


56.5 


na 


- 


Pennsylvania 


117 


42.7 


0 


0.0 


315 


31.7 


0 


0.0 


Rhode Island 


8 


100.0 


0 


0.0 


71 


100.0 


1 


1.0 


South Carolina 


28 


100.0 


9 


20.0 


170 


58.8 


3 


1.1 


South Dakota 


86 


58.1 


0 


0.0 


271 


36.9 


0 


0.0 


Tennessee 


140 


35.7 


na 


- 


1,565 


6.4 


na 




Texas 


1,059 


4.7 


na 




6,849 


1.5 


na 


. 


Utah 


39 


100.0 


0 


0.0 


77 


100.0 


4 


3.0 


Vermont 


138 


36.2 


na 


- 


151 


66.2 


na 


- 


Virginia 


169 


29.6 


na 


- 


1,895 


5.3 


na 




Washington 


305 


16.4 


na 


- 


547 


18.3 


na 


- 


West Virginia 


18 


100.0 


0 


0.0 


133 


75.2 


0 


0.0 


Wisconsin 


65 


76.9 


na 


- 


237 


42.2 


na 


_ 


Wyoming 


18 


100.0 


na 


_ 


82 


100.0 


na 


_ 


Dept, of Defense 


12 


100.0 


na 


- 


165 


60.6 


na 


_ 


American Samoa 


1 


100.0 


na 


- 


31 


100.0 


na 


_ 


Guam 


1 


100.0 


na 


- 


16 


100.0 


na 




North. Marianas 


1 


100.0 


na 


- 


13 


100.0 


na 


_ 


Puerto Rico 


1 


100.0 


2 


100.0 


754 


13.3 


38 


3.9 


Virgin Islands 


1 


100.0 


0 


0.0 


5 


100.0 


3 


27.3 


Notes: ''Not all records in error are reviewed by the respondents. For the agency survey only the top 50 error-filled records (by error 


weight), and for the school survey only the top 100 error-filled records, are sent back to the respondents for review. 




*New Jersey did not submit any data files for 1996-97; na= not available, no response was received as of 30 April 1998. 
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